-- Logs begin at Wed 2022-08-31 10:56:07 UTC, end at Wed 2022-08-31 11:49:43 UTC. -- Aug 31 11:20:06.550892 dv-cinder-839768-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 11:20:06.558099 dv-cinder-839768-3-smb devstack@keystone.service[81435]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 11:20:06 2022] *** Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: nodename: dv-cinder-839768-3-smb Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: machine: x86_64 Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: clock source: unix Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: pcre jit disabled Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: detected number of CPU cores: 4 Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: current working directory: / Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: detected binary path: /usr/bin/uwsgi-core Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: your processes number limit is 47680 Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: your memory page size is 4096 bytes Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: detected max file descriptor number: 2048 Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: lock engine: pthread robust mutexes Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: thunder lock: enabled Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 11:20:06.563396 dv-cinder-839768-3-smb devstack@keystone.service[81435]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 11:20:06.600626 dv-cinder-839768-3-smb devstack@keystone.service[81435]: Python main interpreter initialized at 0x563b523539c0 Aug 31 11:20:06.600626 dv-cinder-839768-3-smb devstack@keystone.service[81435]: python threads support enabled Aug 31 11:20:06.600626 dv-cinder-839768-3-smb devstack@keystone.service[81435]: your server socket listen backlog is limited to 100 connections Aug 31 11:20:06.600626 dv-cinder-839768-3-smb devstack@keystone.service[81435]: your mercy for graceful operations on workers is 90 seconds Aug 31 11:20:06.600985 dv-cinder-839768-3-smb devstack@keystone.service[81435]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 11:20:06.601066 dv-cinder-839768-3-smb devstack@keystone.service[81435]: *** Operational MODE: preforking *** Aug 31 11:20:06.601314 dv-cinder-839768-3-smb devstack@keystone.service[81435]: *** uWSGI is running in multiple interpreter mode *** Aug 31 11:20:06.601314 dv-cinder-839768-3-smb devstack@keystone.service[81435]: spawned uWSGI master process (pid: 81435) Aug 31 11:20:06.601519 dv-cinder-839768-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 11:20:06.603407 dv-cinder-839768-3-smb devstack@keystone.service[81435]: spawned uWSGI worker 1 (pid: 81448, cores: 1) Aug 31 11:20:06.603407 dv-cinder-839768-3-smb devstack@keystone.service[81435]: spawned uWSGI worker 2 (pid: 81449, cores: 1) Aug 31 11:20:06.603407 dv-cinder-839768-3-smb devstack@keystone.service[81435]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 11:20:10.925900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:20:10.925900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Aug 31 11:20:10.926664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:20:10.926664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Aug 31 11:20:10.928825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:20:10.928825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: from cryptography.utils import int_from_bytes Aug 31 11:20:10.929285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:20:10.929285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: from cryptography.utils import int_from_bytes Aug 31 11:20:10.977703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 11:20:10.977902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 11:20:10.978103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] command line args: [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 11:20:10.978349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 11:20:10.978528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ================================================================================ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 11:20:10.978822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.979077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_dir = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.979265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.979450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_source = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.979632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] debug = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.979832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.981227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.981227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.981227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.981227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.981227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.981227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_config_append = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.981584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.981584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_dir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.981894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.982102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.982295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.982479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.982721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.982926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.983115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.983305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.983504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.983753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.983960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.984276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.984511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.984764 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.985017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.985299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.986551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.986917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] publish_errors = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.987211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.987438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.987623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.987896 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.988119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.988359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] standard_threads = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.988597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.988848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.989027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.989207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_journal = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.989463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_json = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.989844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_stderr = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.990067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_syslog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.990308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.991165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.991267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 11:20:10.991365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.991457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 11:20:10.992289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.992289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.992692 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] command line args: [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 11:20:10.992824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.992824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.992824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.992824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.993296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 11:20:10.993618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.993981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ================================================================================ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 11:20:10.994332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.995103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] admin_token = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.995237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.995237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.995237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.995237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.995237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.995237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.995237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.995237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.996728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] config_dir = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.997038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.997194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.997323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.997591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] config_source = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.997591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] debug = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.997864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.998001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.998239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.998373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.998505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.998505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.998796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.998956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.998956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.998956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.999326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.999470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.999639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:10.999788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:10.999967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.000095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.000219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_config_append = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.000219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.000219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_dir = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.000582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.000718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_file = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.000850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.000850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.001087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.001608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.001757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.001878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.001974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.002057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.002117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.002181 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.002292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.002370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.002483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.002572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.002651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.002777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.002777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.002777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.003045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.003124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.003429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.003512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.003581 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.003721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.003828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.003910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.003980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.004065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.004144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.004204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.004272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.004367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.004367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.004538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.004847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.004847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.005090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.005175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.005175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.005506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] publish_errors = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.005602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.005712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.005806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.005906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.006072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.006155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.006276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.006396 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.006489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.006589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.006671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.006762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] standard_threads = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.006819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.006924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.007042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.007170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.007471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.007577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.007646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.007843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.007936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_journal = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.008070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_json = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.008211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.008290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_stderr = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.008359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.008427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_syslog = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.008491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.008667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:20:11.008957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.009054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.009122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.009335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.009479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.009796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.009967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.010113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.010247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.010381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.010507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.010662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.010906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.011029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.011029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.011288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.011415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.011558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.011675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.011761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.011825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.011985 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.012231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.012320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.012483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.012604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.012974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.013074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.013150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.013228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.013290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.013348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.013563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.013656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.014034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.014143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.014208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.014266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.014506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.014642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.014923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.015038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.015172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.015279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.015426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.015534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.015630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.015869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.015985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.016079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.016181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.016311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.016420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.016557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.016736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.016895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.017126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.017372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.017673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.017797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.017961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.018075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.018209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.018344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.018478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.018575 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.018825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.018971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.019162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.019427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.019539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.external = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.019647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.019758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.019898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.020073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.020223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.020353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.020468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.password = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.020614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.token = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.020728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.021040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.021139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.021203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.021262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.021450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.021558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.021778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.022075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.022201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.022288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.022474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.022603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.022767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.023012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.023166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.023349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.023531 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.023659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.023797 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.023919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.024061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.024228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.024421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.024615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.024769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.024978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.025093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.025209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.025326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.025497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.025609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.025927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.026020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.026115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.026244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.026367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.026551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.026845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.026928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.027128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.027241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.027410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.027688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.027766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.027854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.028141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.028293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.028428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.028553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.028640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.028874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.028949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.029282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.029421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.029550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.029681 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.029844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.029980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.030068 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.030174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.030435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.030570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.030773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.030981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.031127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.031311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.031419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.031633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.031724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.031977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.032083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.032253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.033251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.033415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.033592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.033888 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.033975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.034103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.034322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.034457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.034748 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.034881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.035010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.035139 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.035260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.035478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.035562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.035770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.035940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.036102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.036229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.036436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.036572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.036783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.036868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.037071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.037202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.037457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.037646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.037765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.037965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.038050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.038132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.038194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.038333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.038433 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.038624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.038786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.038928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.039032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.039232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.039337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.039576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.039748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.039972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.040142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.040296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.040661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.040746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.040808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.040956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.041107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.041287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.041459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.041592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.041716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.041870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.042011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.042092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.042153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.042212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.042419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.042566 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.042814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.042908 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.043030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.043278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.043369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.043597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.043866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.043968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.044107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.044236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.044372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.044504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.044729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.044853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.045121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.045284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.045471 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.045594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.045690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.045784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.045863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.046094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.046279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.046416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.046552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.046669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.046792 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.external = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.046949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.047082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.047202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.047341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.047448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.047584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.047704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.047929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.password = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.048028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.048729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.048866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.token = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.048987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.049102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.049208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.049305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.049623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.049739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.050027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.050145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.050283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.050394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.050673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.050833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.051093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.051191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.051270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.051344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.051582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.051673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.051847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.051958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.052205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.052297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.052560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.052654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.052888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.053043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.053136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.053205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.053467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.053606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.053802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.053944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.054038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.054138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.054314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.054480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.054636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.054802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.054894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.055109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.055256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.055393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.055580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.055662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.055827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.056025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.056121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.056369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.056510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.056688 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.056788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.057002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.057129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.057269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.057349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.057563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.057653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.057878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.057958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.058186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.058272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.058443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.058534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.058702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.058784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.058964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.059058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.059219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.059310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.059447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.059527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.059683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.059760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.059932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.060018 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.060177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.060256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.060412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.060489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.060650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.060731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.060885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.060964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.061121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.061198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.061362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.061442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.061615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.061695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.061865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.061942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.062096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.062175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.062329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.062407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.062560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.062639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.062841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.062924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.063078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.063156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.063332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.063418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.063586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.063715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.063988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.064067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.064270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.064424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.064512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.064742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.064883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.064968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.065130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.065345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.065434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.065584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.065662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.065824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.065906 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.066070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.066158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.066312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.066391 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.066564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.066643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.066855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.067087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.067166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.067323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.067400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.067560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.067648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.067797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.067877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.068050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.068128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.068299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.068390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.068533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.068611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.068773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.068850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.069003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.069090 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.069238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.069316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.069474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.069551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.069711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.069801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.069948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.070027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.070188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.070266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.070438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.070523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.070702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.070783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.070943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.071027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.071177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.071268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.071420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.071499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.071668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.071746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.071905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.072059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.072136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.072206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.072365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.072449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.072598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.072685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.072838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.072917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.073096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.073187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.073326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.073405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.073574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.073654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.073820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.073900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.074067 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.074146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.074302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.074383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.074532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.074610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.074791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.074873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.075028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.075109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.075261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.075339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.075491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.075570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.075728 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.075846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.075973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.076055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.076209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.076288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.076453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.076536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.076689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.076767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.076917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.076995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.077163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.077243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.077399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.077481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.077631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.077709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.077867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.077946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.078102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.078180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.078274 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 11:20:11.078413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.078579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.078838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.079097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.079373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.079682 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.079975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.080160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.080398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.080647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.080889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.081122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.081360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.081601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.081851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.082100 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.082335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.082588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.082861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.083098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.083347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.083585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.083824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.084060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] role.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.084308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] role.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.084539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.084788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.085038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.085287 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.085535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.085785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.086032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.086280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.086530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.086789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.087042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.087292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.087539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.087793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.088223 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.088463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.088716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.088969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.089220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.089470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.089704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.089958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.090211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.090453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.090724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.090943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.091177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.091430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.091689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.091939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.092178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.092415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.092645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.092883 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.093120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.093370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.093609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.093866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.094114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.094353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.094596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.094866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.095894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.096103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.096343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.096576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.096825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.097096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.097326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.097569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.097841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.098102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.098347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.098595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.098862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.099105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.099340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.099576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.099812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.100047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.100293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.100529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.100774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.101009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.101258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.101494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.101737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.101969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.102208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.102443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:20:11.102613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 11:20:11.108437 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.108673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.108901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.117823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.127984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.128216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.128441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.136728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.146317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.146554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.155539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.155774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.199723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.200789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.249343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.249579 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.250617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.250878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.405455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.405691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.405910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.406134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.406358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.406577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.419692 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.419925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.420146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.420365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.420579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.420789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.430575 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.430847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.431078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.431302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.431523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.431744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.431961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.434163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.434395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.434617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.434858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.435071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.435279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.435487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.443524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.444813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.456298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.456531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.456710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.456937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.457157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.457239 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.457375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.457452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.457592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.457675 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.457848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.458065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.458393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.458610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 11:20:11.474792 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.475006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 11:20:11.475352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.475558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 11:20:11.475785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.475884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.475995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 11:20:11.476102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.476333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.476414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.476531 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 11:20:11.476613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.476806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.477069 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.477570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.477832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.486962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.487249 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.487527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.487818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.488117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.488399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.488670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.488954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.494821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.495843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.497704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.497994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.498280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.498568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.498700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.498882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.498976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.499152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.499261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.499428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.499543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.499708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.499824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.499984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.500085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.500266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.500354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.500538 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.500618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.500984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.502295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.502802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.523925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.525392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.525681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.525762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.527199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.527483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.530205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.530493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.530808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.532103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.532887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.533685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.537978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.538276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.539985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.540272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.542223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.542521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.542835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.543127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.543407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.544314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.544607 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.544890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.545170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.545340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.545449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.545639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.545719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.545935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.546015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.546231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.561520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.561808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.565156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.565431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.566176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.569267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.569352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.569570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.572809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.573111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.573852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.576955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.577367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.580220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.580529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.580818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.581038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.581121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.581375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.581764 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.584260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.584572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.584858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.585143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.585432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.585726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.598219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.598514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.598812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.599087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.602721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.603015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.603285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.603553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.605822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.607514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.609038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.609320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.610413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.612051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.612341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.612424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.612642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.612929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.613223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.613953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.614234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.616873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.617168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.617567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.617854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.618143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.624563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.624855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.625141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.625426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.625718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.626002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.626837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.630443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.630756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.631137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.631420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.631706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.631990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.632290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.642257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.645392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.648316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.648436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.649745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.651255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.651388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.651556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.651852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.654169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.656147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.658753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.659051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.659340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.659424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.660838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.663746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.664056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.664352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.664639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.665661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.667183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.670157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.670798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.670798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.671042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.672594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.672893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.673732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.680341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.680639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.680863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.680946 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.681156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.681448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.681731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.682010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.682291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.682582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.682891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.683177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.683458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.683733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.683999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.684271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.684561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.687990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 11:20:11.688279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.688567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.689289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.689576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.689868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.690154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.690433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.690805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.691094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.691372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.691641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.691908 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.692187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 11:20:11.718864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b523539c0 pid: 81449 (default app) Aug 31 11:20:11.723106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79b450-79e3-4909-a63a-2f5a408cdee3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:11.723394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79b450-79e3-4909-a63a-2f5a408cdee3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:11.723669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79b450-79e3-4909-a63a-2f5a408cdee3 None None] PATH_INFO: `/v3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:11.727746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b523539c0 pid: 81448 (default app) Aug 31 11:20:11.727890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Wed Aug 31 11:20:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:18.302275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226c28b-a47b-4b26-b402-ab4491175791 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:18.302834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226c28b-a47b-4b26-b402-ab4491175791 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:18.302834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226c28b-a47b-4b26-b402-ab4491175791 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:18.307922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:18.313369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:18.313917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:18.314213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:18.385631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: INFO dbcounter [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] Registered counter for database keystone Aug 31 11:20:18.404544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:20:18.411468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writer thread running {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:20:18.592082 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81449) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 11:20:18.592386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81449) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 11:20:18.652080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:18.653689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:18.783805 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 11:20:19.248260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226c28b-a47b-4b26-b402-ab4491175791 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:19.319408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: INFO dbcounter [None req-b226c28b-a47b-4b26-b402-ab4491175791 None None] Registered counter for database keystone Aug 31 11:20:19.341008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG oslo_db.sqlalchemy.engines [None req-b226c28b-a47b-4b26-b402-ab4491175791 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:20:19.347329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writer thread running {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:20:19.466029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226c28b-a47b-4b26-b402-ab4491175791 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:19.470700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517fbb6-415e-4d91-b2d4-e630d1ca961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:19.471334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517fbb6-415e-4d91-b2d4-e630d1ca961d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:19.471610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517fbb6-415e-4d91-b2d4-e630d1ca961d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:19.471876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517fbb6-415e-4d91-b2d4-e630d1ca961d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:19.479826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517fbb6-415e-4d91-b2d4-e630d1ca961d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:19.531645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7517fbb6-415e-4d91-b2d4-e630d1ca961d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 11:20:19.531930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517fbb6-415e-4d91-b2d4-e630d1ca961d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:19.541310 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Aug 31 11:20:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 11:20:19.547407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:19.562294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c188ab-9e1d-42f1-9ddb-1f73fc3a7c19 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:19.567455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cece8-9ae7-4fd6-bfd6-b8a25900b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:19.568545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cece8-9ae7-4fd6-bfd6-b8a25900b04e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:19.568829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cece8-9ae7-4fd6-bfd6-b8a25900b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:19.569101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cece8-9ae7-4fd6-bfd6-b8a25900b04e admin admin] PATH_INFO: `/v3/projects/677626bf39d04fc896037ceef125a07a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:19.570666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cece8-9ae7-4fd6-bfd6-b8a25900b04e admin admin] RBAC: Authorizing `identity:get_project(project_id=677626bf39d04fc896037ceef125a07a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:19.623193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f66cece8-9ae7-4fd6-bfd6-b8a25900b04e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 11:20:19.623536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cece8-9ae7-4fd6-bfd6-b8a25900b04e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:19.629128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Aug 31 11:20:19 2022] GET /identity/v3/projects/677626bf39d04fc896037ceef125a07a => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:21.524553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9a08-bd02-4b24-a09a-68ec2925e55a None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:21.525168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9a08-bd02-4b24-a09a-68ec2925e55a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:21.525168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9a08-bd02-4b24-a09a-68ec2925e55a None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:21.529204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:21.534916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7bab-e9b2-445a-82fc-f00fad4fefd4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:21.535348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7bab-e9b2-445a-82fc-f00fad4fefd4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:21.535472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7bab-e9b2-445a-82fc-f00fad4fefd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:21.555195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3eec7bab-e9b2-445a-82fc-f00fad4fefd4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:21.556699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3eec7bab-e9b2-445a-82fc-f00fad4fefd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:21.564921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 11:20:21.835858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb9a08-bd02-4b24-a09a-68ec2925e55a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:21.848695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb9a08-bd02-4b24-a09a-68ec2925e55a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:21.853117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186667c-e8bb-492b-ad8e-3744f6b0da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:21.853718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186667c-e8bb-492b-ad8e-3744f6b0da4b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:21.853995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186667c-e8bb-492b-ad8e-3744f6b0da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:21.854266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186667c-e8bb-492b-ad8e-3744f6b0da4b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:21.861908 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186667c-e8bb-492b-ad8e-3744f6b0da4b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:21.863719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186667c-e8bb-492b-ad8e-3744f6b0da4b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:21.872251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Aug 31 11:20:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:20:21.877551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec7bab-e9b2-445a-82fc-f00fad4fefd4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:21.886573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec7bab-e9b2-445a-82fc-f00fad4fefd4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:21.890898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22d874-cac1-4e2f-b614-bbd9c4d7f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:21.892024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22d874-cac1-4e2f-b614-bbd9c4d7f55e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:21.892296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22d874-cac1-4e2f-b614-bbd9c4d7f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:21.892567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22d874-cac1-4e2f-b614-bbd9c4d7f55e admin admin] PATH_INFO: `/v3/users/839a76c19ea54ec68f0ff11e282ae859` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:21.893873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22d874-cac1-4e2f-b614-bbd9c4d7f55e admin admin] RBAC: Authorizing `identity:get_user(user_id=839a76c19ea54ec68f0ff11e282ae859)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:21.895765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22d874-cac1-4e2f-b614-bbd9c4d7f55e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:21.897287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Wed Aug 31 11:20:21 2022] GET /identity/v3/users/839a76c19ea54ec68f0ff11e282ae859 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:23.950279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5f391-2eb2-4f70-9388-170e4e818952 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:23.950833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5f391-2eb2-4f70-9388-170e4e818952 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:23.950833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5f391-2eb2-4f70-9388-170e4e818952 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:23.952112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:23.955598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811810d-7eb3-4584-acdc-4f7d7cb2ac97 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:23.956025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811810d-7eb3-4584-acdc-4f7d7cb2ac97 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:23.956127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811810d-7eb3-4584-acdc-4f7d7cb2ac97 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:23.957514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:23.957631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a28b6-1d62-49cd-b518-cb3567faf17f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:23.957826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a28b6-1d62-49cd-b518-cb3567faf17f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:23.958106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a28b6-1d62-49cd-b518-cb3567faf17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:23.962435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed6a08-259a-4824-aaf8-2ebe0c3975b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:23.962757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed6a08-259a-4824-aaf8-2ebe0c3975b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:23.963044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed6a08-259a-4824-aaf8-2ebe0c3975b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:23.982644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-99ed6a08-259a-4824-aaf8-2ebe0c3975b2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:23.983856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-99ed6a08-259a-4824-aaf8-2ebe0c3975b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:24.000606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG passlib.handlers.bcrypt [None req-8e3a28b6-1d62-49cd-b518-cb3567faf17f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81448) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 11:20:24.001061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG passlib.handlers.bcrypt [None req-8e3a28b6-1d62-49cd-b518-cb3567faf17f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81448) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 11:20:24.050497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8e3a28b6-1d62-49cd-b518-cb3567faf17f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:24.052141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8e3a28b6-1d62-49cd-b518-cb3567faf17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:24.062762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 7/12] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:24.151973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 6/13] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:24.329644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed6a08-259a-4824-aaf8-2ebe0c3975b2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:24.353709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:24.430436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a28b6-1d62-49cd-b518-cb3567faf17f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:24.434464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed6a08-259a-4824-aaf8-2ebe0c3975b2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:24.469343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6072f-21f7-4eb7-90dd-c96de2be21d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:24.470876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6072f-21f7-4eb7-90dd-c96de2be21d1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:24.471158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6072f-21f7-4eb7-90dd-c96de2be21d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:24.471428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6072f-21f7-4eb7-90dd-c96de2be21d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:24.482389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6072f-21f7-4eb7-90dd-c96de2be21d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-63f6072f-21f7-4eb7-90dd-c96de2be21d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:24.491771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:24.492850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:24.494003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 8/14] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:20:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:24.498624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6072f-21f7-4eb7-90dd-c96de2be21d1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:24.536959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a28b6-1d62-49cd-b518-cb3567faf17f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:24.539263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:24.574694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472b80-1033-49d4-896e-e0a6b091bef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:24.575579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472b80-1033-49d4-896e-e0a6b091bef9 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:24.575859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472b80-1033-49d4-896e-e0a6b091bef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:24.576131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472b80-1033-49d4-896e-e0a6b091bef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:24.580926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:24.600431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6072f-21f7-4eb7-90dd-c96de2be21d1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:24.634887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b1172-414e-46bb-a71d-00bb9c241555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:24.635495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b1172-414e-46bb-a71d-00bb9c241555 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:24.635778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b1172-414e-46bb-a71d-00bb9c241555 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:24.636053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b1172-414e-46bb-a71d-00bb9c241555 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:24.636726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b1172-414e-46bb-a71d-00bb9c241555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:24.637030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b1172-414e-46bb-a71d-00bb9c241555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:24.638445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b1172-414e-46bb-a71d-00bb9c241555 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:24.643433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472b80-1033-49d4-896e-e0a6b091bef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:24.644943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472b80-1033-49d4-896e-e0a6b091bef9 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:24.651342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 9/15] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:24.656931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b1172-414e-46bb-a71d-00bb9c241555 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:24.743941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 7/16] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 11:20:24.749653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472b80-1033-49d4-896e-e0a6b091bef9 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:24.752574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:24.757491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b1172-414e-46bb-a71d-00bb9c241555 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:24.791773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee881d5b-64c1-4862-a510-18ccb7b8d810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:24.792393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee881d5b-64c1-4862-a510-18ccb7b8d810 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:24.792669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee881d5b-64c1-4862-a510-18ccb7b8d810 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:24.792940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee881d5b-64c1-4862-a510-18ccb7b8d810 None admin] PATH_INFO: `/v3/users/839a76c19ea54ec68f0ff11e282ae859` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:24.794065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee881d5b-64c1-4862-a510-18ccb7b8d810 None admin] RBAC: Authorizing `identity:get_user(user_id=839a76c19ea54ec68f0ff11e282ae859)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:24.795553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee881d5b-64c1-4862-a510-18ccb7b8d810 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:24.797258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 10/17] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:24 2022] GET /identity/v3/users/839a76c19ea54ec68f0ff11e282ae859 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:24.802547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee881d5b-64c1-4862-a510-18ccb7b8d810 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:24.816632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:24.849472 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472b80-1033-49d4-896e-e0a6b091bef9 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:24.881995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e094-4eff-464c-b08f-56a1762ac303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:24.882879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e094-4eff-464c-b08f-56a1762ac303 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:24.883161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e094-4eff-464c-b08f-56a1762ac303 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:24.883438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e094-4eff-464c-b08f-56a1762ac303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:24.902243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e094-4eff-464c-b08f-56a1762ac303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:24.902398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee881d5b-64c1-4862-a510-18ccb7b8d810 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:24.903750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e094-4eff-464c-b08f-56a1762ac303 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3200e094-4eff-464c-b08f-56a1762ac303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:20:24.922268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:24.923530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:20:24.924340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:20:24.924340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:20:24.924340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:24.924340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 8/18] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:20:24.930597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e094-4eff-464c-b08f-56a1762ac303 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:24.936999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81f51c-189c-450f-9057-bad42e8d34e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:24.937626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f51c-189c-450f-9057-bad42e8d34e4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:24.937903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f51c-189c-450f-9057-bad42e8d34e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:24.938178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f51c-189c-450f-9057-bad42e8d34e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:24.939669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81f51c-189c-450f-9057-bad42e8d34e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:24.940749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81f51c-189c-450f-9057-bad42e8d34e4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:24.942422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 11/19] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:24.948000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81f51c-189c-450f-9057-bad42e8d34e4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:24.986803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:25.028361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:25.039038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e094-4eff-464c-b08f-56a1762ac303 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:25.048328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81f51c-189c-450f-9057-bad42e8d34e4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:25.071905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d9d33-005f-4a8e-96c0-eba1a32b03ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:25.072497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9d33-005f-4a8e-96c0-eba1a32b03ce None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:25.072778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9d33-005f-4a8e-96c0-eba1a32b03ce None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:25.073046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9d33-005f-4a8e-96c0-eba1a32b03ce None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:25.073670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d9d33-005f-4a8e-96c0-eba1a32b03ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:25.073968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d9d33-005f-4a8e-96c0-eba1a32b03ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:25.075376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d9d33-005f-4a8e-96c0-eba1a32b03ce None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:25.082621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15eb91-a087-47a2-ba23-39113850dc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:25.083254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15eb91-a087-47a2-ba23-39113850dc73 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:25.083537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15eb91-a087-47a2-ba23-39113850dc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:25.083812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15eb91-a087-47a2-ba23-39113850dc73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:25.084539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15eb91-a087-47a2-ba23-39113850dc73 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.domain.id=default, user.id=839a76c19ea54ec68f0ff11e282ae859) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:25.084843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15eb91-a087-47a2-ba23-39113850dc73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:25.086281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15eb91-a087-47a2-ba23-39113850dc73 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:25.092931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 9/20] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:25.093079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 12/21] 10.222.0.64 () {56 vars in 1322 bytes} [Wed Aug 31 11:20:24 2022] GET /identity/v3/role_assignments?user.id=839a76c19ea54ec68f0ff11e282ae859&scope.domain.id=default&role.id=946af2ff291349299db56e09aacb6b03 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:27.317301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53353-d2c2-4784-b79c-ffe9d870952d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:27.317850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53353-d2c2-4784-b79c-ffe9d870952d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:27.317850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53353-d2c2-4784-b79c-ffe9d870952d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:27.319253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 10/22] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:27.324724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3725aeb-6301-4bdc-81e9-b743896ff8ad None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:27.325134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3725aeb-6301-4bdc-81e9-b743896ff8ad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:27.325329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3725aeb-6301-4bdc-81e9-b743896ff8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:27.351688 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c3725aeb-6301-4bdc-81e9-b743896ff8ad None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:27.352892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3725aeb-6301-4bdc-81e9-b743896ff8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:27.385403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391b924-e75e-40c9-854a-ab5a82759236 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:27.385678 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391b924-e75e-40c9-854a-ab5a82759236 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:27.385948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391b924-e75e-40c9-854a-ab5a82759236 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:27.387482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 11/23] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:20:27.392794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9269d0-fab5-49b8-9d79-97a7fa502c01 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:27.393082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9269d0-fab5-49b8-9d79-97a7fa502c01 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:27.393360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9269d0-fab5-49b8-9d79-97a7fa502c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:27.413336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6e9269d0-fab5-49b8-9d79-97a7fa502c01 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:27.414576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6e9269d0-fab5-49b8-9d79-97a7fa502c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:27.441610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 13/24] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:27.514953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 12/25] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:27.678940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f874a5-82b0-42b8-ae95-cf6508751eb9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:27.679470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f874a5-82b0-42b8-ae95-cf6508751eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:27.679936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f874a5-82b0-42b8-ae95-cf6508751eb9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:27.681482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 14/26] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:27.686889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dd23d-eb7d-4566-adb8-93ad2938ec62 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:27.687419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dd23d-eb7d-4566-adb8-93ad2938ec62 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:27.687882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dd23d-eb7d-4566-adb8-93ad2938ec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:27.715245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ad1dd23d-eb7d-4566-adb8-93ad2938ec62 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:27.716436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ad1dd23d-eb7d-4566-adb8-93ad2938ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:27.775425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:27.808405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 13/27] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:27.906883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f874a5-82b0-42b8-ae95-cf6508751eb9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:27.984663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf48a-fdc9-4ea8-be62-443577d8b272 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:27.984947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf48a-fdc9-4ea8-be62-443577d8b272 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:27.985213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf48a-fdc9-4ea8-be62-443577d8b272 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:27.986646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 14/28] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:20:27.997856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276c1c-2076-476e-85e3-1e187ac3b4a0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:27.998145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276c1c-2076-476e-85e3-1e187ac3b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:27.998428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276c1c-2076-476e-85e3-1e187ac3b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:28.009989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:28.037168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9d276c1c-2076-476e-85e3-1e187ac3b4a0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:28.038362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9d276c1c-2076-476e-85e3-1e187ac3b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:28.055078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f874a5-82b0-42b8-ae95-cf6508751eb9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:28.126179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558b2f7-dec4-4883-b166-52e653bfbe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:28.127080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558b2f7-dec4-4883-b166-52e653bfbe43 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:28.128298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558b2f7-dec4-4883-b166-52e653bfbe43 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:28.128578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558b2f7-dec4-4883-b166-52e653bfbe43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:28.153489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558b2f7-dec4-4883-b166-52e653bfbe43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:28.162670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 15/29] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:28.163610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d276c1c-2076-476e-85e3-1e187ac3b4a0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2558b2f7-dec4-4883-b166-52e653bfbe43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:28.164358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:28.165175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:28.166297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 15/30] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:20:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:28.176761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558b2f7-dec4-4883-b166-52e653bfbe43 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:28.312967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d276c1c-2076-476e-85e3-1e187ac3b4a0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:28.321395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:28.354028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a023c7-23f9-4ba6-a54e-c4ff0b8be69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:28.354645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a023c7-23f9-4ba6-a54e-c4ff0b8be69d None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:28.354949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a023c7-23f9-4ba6-a54e-c4ff0b8be69d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:28.355225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a023c7-23f9-4ba6-a54e-c4ff0b8be69d None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:28.356909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a023c7-23f9-4ba6-a54e-c4ff0b8be69d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:28.358315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a023c7-23f9-4ba6-a54e-c4ff0b8be69d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:28.414531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558b2f7-dec4-4883-b166-52e653bfbe43 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:28.471973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb271c1-dce4-4081-94eb-9c7f1ec30902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:28.472672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb271c1-dce4-4081-94eb-9c7f1ec30902 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:28.472958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb271c1-dce4-4081-94eb-9c7f1ec30902 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:28.473229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb271c1-dce4-4081-94eb-9c7f1ec30902 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:28.473900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb271c1-dce4-4081-94eb-9c7f1ec30902 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:28.474203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb271c1-dce4-4081-94eb-9c7f1ec30902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:28.475723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb271c1-dce4-4081-94eb-9c7f1ec30902 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:28.483590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:28.493739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 16/31] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:28.494567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb271c1-dce4-4081-94eb-9c7f1ec30902 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:28.520666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 16/32] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 31 11:20:28 2022] POST /identity/v3/roles => generated 219 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:28.526435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a023c7-23f9-4ba6-a54e-c4ff0b8be69d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:28.642949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb271c1-dce4-4081-94eb-9c7f1ec30902 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:28.692685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f2aa2-c5b2-4dd5-90c0-d3aaa087e45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:28.692685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f2aa2-c5b2-4dd5-90c0-d3aaa087e45c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:28.692685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f2aa2-c5b2-4dd5-90c0-d3aaa087e45c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:28.692685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f2aa2-c5b2-4dd5-90c0-d3aaa087e45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:28.704843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f2aa2-c5b2-4dd5-90c0-d3aaa087e45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:28.706763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f2aa2-c5b2-4dd5-90c0-d3aaa087e45c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:28.708983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a023c7-23f9-4ba6-a54e-c4ff0b8be69d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a36f2aa2-c5b2-4dd5-90c0-d3aaa087e45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:20:28.731130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:28.732025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:20:28.732809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:20:28.732809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:20:28.732809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:28.735086 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 17/33] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:28.736153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f2aa2-c5b2-4dd5-90c0-d3aaa087e45c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:28.749582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c8898-1de6-41db-8beb-1125b60c667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:28.750276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c8898-1de6-41db-8beb-1125b60c667b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:28.750819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c8898-1de6-41db-8beb-1125b60c667b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:28.751377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c8898-1de6-41db-8beb-1125b60c667b None admin] PATH_INFO: `/v3/users/839a76c19ea54ec68f0ff11e282ae859` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:28.753231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c8898-1de6-41db-8beb-1125b60c667b None admin] RBAC: Authorizing `identity:get_user(user_id=839a76c19ea54ec68f0ff11e282ae859)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:28.756093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c8898-1de6-41db-8beb-1125b60c667b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:28.757933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 17/34] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:28 2022] GET /identity/v3/users/839a76c19ea54ec68f0ff11e282ae859 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:28.758956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c8898-1de6-41db-8beb-1125b60c667b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:28.796711 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:28.819101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:28.861461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f2aa2-c5b2-4dd5-90c0-d3aaa087e45c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:28.874547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c8898-1de6-41db-8beb-1125b60c667b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:28.901873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59864a0-b49a-4068-8571-6b7a6258104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:28.902412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59864a0-b49a-4068-8571-6b7a6258104a None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:28.902708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59864a0-b49a-4068-8571-6b7a6258104a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:28.902995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59864a0-b49a-4068-8571-6b7a6258104a None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:28.903676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59864a0-b49a-4068-8571-6b7a6258104a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:28.905189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59864a0-b49a-4068-8571-6b7a6258104a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:28.914247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda168e4-b9d1-4337-8b45-5220222d32b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:28.915375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda168e4-b9d1-4337-8b45-5220222d32b3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:28.915936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda168e4-b9d1-4337-8b45-5220222d32b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:28.916486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda168e4-b9d1-4337-8b45-5220222d32b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:28.917390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda168e4-b9d1-4337-8b45-5220222d32b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:28.918028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda168e4-b9d1-4337-8b45-5220222d32b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:28.919952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda168e4-b9d1-4337-8b45-5220222d32b3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:28.933087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 18/35] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:28.934288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda168e4-b9d1-4337-8b45-5220222d32b3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:29.030973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 18/36] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 31 11:20:28 2022] POST /identity/v3/roles => generated 225 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:29.033030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7aba2-59c4-4099-9d9c-a276c5c4b76d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:29.033362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7aba2-59c4-4099-9d9c-a276c5c4b76d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:29.033644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7aba2-59c4-4099-9d9c-a276c5c4b76d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:29.035250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 19/37] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:29.035986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7aba2-59c4-4099-9d9c-a276c5c4b76d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:29.044470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:29.055176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda168e4-b9d1-4337-8b45-5220222d32b3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:29.099872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30796f9-e10b-41e3-a742-369b6c93eb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:29.100881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30796f9-e10b-41e3-a742-369b6c93eb95 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:29.101383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30796f9-e10b-41e3-a742-369b6c93eb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:29.101872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30796f9-e10b-41e3-a742-369b6c93eb95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:29.103557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30796f9-e10b-41e3-a742-369b6c93eb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:29.114727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30796f9-e10b-41e3-a742-369b6c93eb95 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:29.116912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 19/38] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:29.119005 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a72964-9911-46ea-9547-227339f3ef62 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:29.119567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a72964-9911-46ea-9547-227339f3ef62 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:29.120042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a72964-9911-46ea-9547-227339f3ef62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:29.140041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-23a72964-9911-46ea-9547-227339f3ef62 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:29.143299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-23a72964-9911-46ea-9547-227339f3ef62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:29.181239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7aba2-59c4-4099-9d9c-a276c5c4b76d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:29.195085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:29.223263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 20/39] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:29.224667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38094ec-6214-48f7-a18e-7634895585ee None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:29.224966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38094ec-6214-48f7-a18e-7634895585ee None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:29.225245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38094ec-6214-48f7-a18e-7634895585ee None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:29.226511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 21/40] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:29.227234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38094ec-6214-48f7-a18e-7634895585ee None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:29.240540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6953c39-69ad-481e-8fc0-06d3bc080128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:29.241250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953c39-69ad-481e-8fc0-06d3bc080128 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:29.241445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953c39-69ad-481e-8fc0-06d3bc080128 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:29.241718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953c39-69ad-481e-8fc0-06d3bc080128 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:29.242368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6953c39-69ad-481e-8fc0-06d3bc080128 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:29.245651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6953c39-69ad-481e-8fc0-06d3bc080128 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:29.280773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:20:29 2022] POST /identity/v3/projects => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:29.282466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a990a2-f55d-431e-a880-dfb7f9824178 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:29.282845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a990a2-f55d-431e-a880-dfb7f9824178 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:29.283131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a990a2-f55d-431e-a880-dfb7f9824178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:29.324087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b3a990a2-f55d-431e-a880-dfb7f9824178 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:29.326391 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b3a990a2-f55d-431e-a880-dfb7f9824178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:29.345939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:29.359680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38094ec-6214-48f7-a18e-7634895585ee None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:29.402597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83984c2-c6f4-4614-8410-9902fa2eaf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:29.403824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83984c2-c6f4-4614-8410-9902fa2eaf1f None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:29.404359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83984c2-c6f4-4614-8410-9902fa2eaf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:29.404838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83984c2-c6f4-4614-8410-9902fa2eaf1f None admin] PATH_INFO: `/v3/domains/default/users/839a76c19ea54ec68f0ff11e282ae859/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:29.407684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83984c2-c6f4-4614-8410-9902fa2eaf1f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=839a76c19ea54ec68f0ff11e282ae859, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:29.409706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83984c2-c6f4-4614-8410-9902fa2eaf1f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:29.427794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 21/42] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:29.432101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 22/43] 10.222.0.64 () {58 vars in 1361 bytes} [Wed Aug 31 11:20:29 2022] PUT /identity/v3/domains/default/users/839a76c19ea54ec68f0ff11e282ae859/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:29.499480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a990a2-f55d-431e-a880-dfb7f9824178 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:29.602614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:29.614543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a990a2-f55d-431e-a880-dfb7f9824178 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:29.705066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83984c2-c6f4-4614-8410-9902fa2eaf1f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:29.760741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ee13-3886-4383-9707-908fecd55431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:29.761361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ee13-3886-4383-9707-908fecd55431 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:29.761645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ee13-3886-4383-9707-908fecd55431 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:29.761921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ee13-3886-4383-9707-908fecd55431 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:29.762608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47ee13-3886-4383-9707-908fecd55431 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:29.764041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47ee13-3886-4383-9707-908fecd55431 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:29.781322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 22/44] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 31 11:20:29 2022] POST /identity/v3/roles => generated 223 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:29.817243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83984c2-c6f4-4614-8410-9902fa2eaf1f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:29.856012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e9afe-0a92-4a23-8b6a-3969c4638cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:29.856668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9afe-0a92-4a23-8b6a-3969c4638cad None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:29.856952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9afe-0a92-4a23-8b6a-3969c4638cad None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:29.857303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9afe-0a92-4a23-8b6a-3969c4638cad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:29.858559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e9afe-0a92-4a23-8b6a-3969c4638cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:29.860687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e9afe-0a92-4a23-8b6a-3969c4638cad None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:29.862733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 23/45] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:29.870181 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ee13-3886-4383-9707-908fecd55431 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:29.998195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ee13-3886-4383-9707-908fecd55431 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:30.032656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172e518-a004-445c-a909-f739a2fbe197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:30.033440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172e518-a004-445c-a909-f739a2fbe197 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:30.033725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172e518-a004-445c-a909-f739a2fbe197 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:30.034002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172e518-a004-445c-a909-f739a2fbe197 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:30.034649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172e518-a004-445c-a909-f739a2fbe197 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:30.036127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172e518-a004-445c-a909-f739a2fbe197 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:30.061884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:20:29 2022] POST /identity/v3/projects => generated 312 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:31.409823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d58ab4-51c4-4784-bfce-34ec8518d877 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:31.410345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d58ab4-51c4-4784-bfce-34ec8518d877 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:31.410458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d58ab4-51c4-4784-bfce-34ec8518d877 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:31.411756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 24/47] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:31.417056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4488070-4646-4f9b-92a5-a929b77c560d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:31.417452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4488070-4646-4f9b-92a5-a929b77c560d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:31.417715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4488070-4646-4f9b-92a5-a929b77c560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:31.424529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:31.437690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f4488070-4646-4f9b-92a5-a929b77c560d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:31.439746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f4488070-4646-4f9b-92a5-a929b77c560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:31.506038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:31.777672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d58ab4-51c4-4784-bfce-34ec8518d877 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:31.801084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:31.881641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d58ab4-51c4-4784-bfce-34ec8518d877 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:31.915484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db0938-bbcd-4bd0-8968-9b811ad95333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:31.916111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0938-bbcd-4bd0-8968-9b811ad95333 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:31.916395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0938-bbcd-4bd0-8968-9b811ad95333 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:31.916671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0938-bbcd-4bd0-8968-9b811ad95333 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:31.928858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db0938-bbcd-4bd0-8968-9b811ad95333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-33db0938-bbcd-4bd0-8968-9b811ad95333 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:31.934785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:31.935616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:31.936526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 25/49] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:20:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:31.941756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4488070-4646-4f9b-92a5-a929b77c560d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:31.976482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965468-4d3d-408a-b466-6dbd04bbb714 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:31.976768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965468-4d3d-408a-b466-6dbd04bbb714 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:31.977045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965468-4d3d-408a-b466-6dbd04bbb714 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:31.978380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 26/50] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:20:31.983051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd97482-32b0-41bf-a105-8aed4e24575d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:31.983337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd97482-32b0-41bf-a105-8aed4e24575d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:31.983614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd97482-32b0-41bf-a105-8aed4e24575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:32.004355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ccd97482-32b0-41bf-a105-8aed4e24575d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:32.005565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ccd97482-32b0-41bf-a105-8aed4e24575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:32.041609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4488070-4646-4f9b-92a5-a929b77c560d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:32.071085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:32.071393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 27/51] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:32.083161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee5b01-fa48-4c65-b814-d16a7014e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:32.083777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee5b01-fa48-4c65-b814-d16a7014e22f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:32.084062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee5b01-fa48-4c65-b814-d16a7014e22f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:32.084353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee5b01-fa48-4c65-b814-d16a7014e22f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:32.085010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee5b01-fa48-4c65-b814-d16a7014e22f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:32.085316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee5b01-fa48-4c65-b814-d16a7014e22f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:32.086732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee5b01-fa48-4c65-b814-d16a7014e22f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:32.095826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 25/52] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:32.101242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd97482-32b0-41bf-a105-8aed4e24575d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:32.113545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:32.197658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd97482-32b0-41bf-a105-8aed4e24575d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:32.231437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85e8fb-3377-478e-b766-779dda493497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:32.232068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85e8fb-3377-478e-b766-779dda493497 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:32.232352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85e8fb-3377-478e-b766-779dda493497 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:32.232630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85e8fb-3377-478e-b766-779dda493497 None admin] PATH_INFO: `/v3/users/839a76c19ea54ec68f0ff11e282ae859` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:32.233777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85e8fb-3377-478e-b766-779dda493497 None admin] RBAC: Authorizing `identity:get_user(user_id=839a76c19ea54ec68f0ff11e282ae859)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:32.235598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85e8fb-3377-478e-b766-779dda493497 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:32.237402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 28/53] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:32 2022] GET /identity/v3/users/839a76c19ea54ec68f0ff11e282ae859 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:32.242804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee5b01-fa48-4c65-b814-d16a7014e22f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:32.343134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee5b01-fa48-4c65-b814-d16a7014e22f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:32.347994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85e8fb-3377-478e-b766-779dda493497 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:32.377533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fcf6d-7ee0-4cf1-89aa-0ee02bc66ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:32.378204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcf6d-7ee0-4cf1-89aa-0ee02bc66ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:32.378490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcf6d-7ee0-4cf1-89aa-0ee02bc66ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:32.378799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcf6d-7ee0-4cf1-89aa-0ee02bc66ef4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:32.379930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fcf6d-7ee0-4cf1-89aa-0ee02bc66ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:32.381402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fcf6d-7ee0-4cf1-89aa-0ee02bc66ef4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:32.383019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 26/54] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:32.388681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fcf6d-7ee0-4cf1-89aa-0ee02bc66ef4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:32.427137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:32.448676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:32.450315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85e8fb-3377-478e-b766-779dda493497 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:32.489898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fcf6d-7ee0-4cf1-89aa-0ee02bc66ef4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:32.526777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a319-f79c-4229-ae5b-8069f1f7474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:32.527399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a319-f79c-4229-ae5b-8069f1f7474c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:32.527680 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a319-f79c-4229-ae5b-8069f1f7474c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:32.527955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a319-f79c-4229-ae5b-8069f1f7474c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:32.528695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79a319-f79c-4229-ae5b-8069f1f7474c None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.domain.id=default, user.id=839a76c19ea54ec68f0ff11e282ae859) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:32.529006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79a319-f79c-4229-ae5b-8069f1f7474c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:32.530487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79a319-f79c-4229-ae5b-8069f1f7474c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:32.537929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1322 bytes} [Wed Aug 31 11:20:32 2022] GET /identity/v3/role_assignments?user.id=839a76c19ea54ec68f0ff11e282ae859&scope.domain.id=default&role.id=946af2ff291349299db56e09aacb6b03 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:32.591410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a3ee6-f724-4f81-b4d7-828de7a868eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:32.592071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3ee6-f724-4f81-b4d7-828de7a868eb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:32.592355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3ee6-f724-4f81-b4d7-828de7a868eb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:32.592631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3ee6-f724-4f81-b4d7-828de7a868eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:32.593811 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3ee6-f724-4f81-b4d7-828de7a868eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:32.595810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3ee6-f724-4f81-b4d7-828de7a868eb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:32.597442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 29/56] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:32.603278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a319-f79c-4229-ae5b-8069f1f7474c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:32.712218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a319-f79c-4229-ae5b-8069f1f7474c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:32.742538 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:32.752291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bea94a-35aa-48f0-ba3a-2e0a1810bcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:32.752901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bea94a-35aa-48f0-ba3a-2e0a1810bcbf None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:32.753182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bea94a-35aa-48f0-ba3a-2e0a1810bcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:32.753455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bea94a-35aa-48f0-ba3a-2e0a1810bcbf None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:32.754112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bea94a-35aa-48f0-ba3a-2e0a1810bcbf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:32.755588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bea94a-35aa-48f0-ba3a-2e0a1810bcbf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:32.781399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 28/57] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Aug 31 11:20:32 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:20:34.671017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bd47f-8f7b-4479-9828-96354be68115 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:34.671017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bd47f-8f7b-4479-9828-96354be68115 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:34.671442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bd47f-8f7b-4479-9828-96354be68115 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:34.672957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 30/58] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:34.678300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7084d-1f68-4eb7-8c5f-3cc0df79ce72 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:34.678736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7084d-1f68-4eb7-8c5f-3cc0df79ce72 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:34.678878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7084d-1f68-4eb7-8c5f-3cc0df79ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:34.697198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c5d7084d-1f68-4eb7-8c5f-3cc0df79ce72 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:34.698391 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c5d7084d-1f68-4eb7-8c5f-3cc0df79ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:34.763128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 29/59] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:35.031246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bd47f-8f7b-4479-9828-96354be68115 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:35.129645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bd47f-8f7b-4479-9828-96354be68115 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:35.162873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07a413-bf87-4d64-9cc5-9d2ec591653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:35.163567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07a413-bf87-4d64-9cc5-9d2ec591653e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:35.163957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07a413-bf87-4d64-9cc5-9d2ec591653e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:35.164361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07a413-bf87-4d64-9cc5-9d2ec591653e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:35.165615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07a413-bf87-4d64-9cc5-9d2ec591653e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:35.167105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07a413-bf87-4d64-9cc5-9d2ec591653e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:35.168661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 31/60] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:35.174389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7084d-1f68-4eb7-8c5f-3cc0df79ce72 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:35.270499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7084d-1f68-4eb7-8c5f-3cc0df79ce72 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:35.279367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:35.304401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b18f0-6be0-4078-8fb7-f36e869550ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:35.304947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b18f0-6be0-4078-8fb7-f36e869550ac None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:35.305228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b18f0-6be0-4078-8fb7-f36e869550ac None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:35.305503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b18f0-6be0-4078-8fb7-f36e869550ac None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:35.306151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b18f0-6be0-4078-8fb7-f36e869550ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:35.307620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b18f0-6be0-4078-8fb7-f36e869550ac None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:35.332838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 30/61] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:20:35 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:38.276182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9425-e625-4a97-af0e-4adfb6e8f615 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.276709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9425-e625-4a97-af0e-4adfb6e8f615 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.276709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9425-e625-4a97-af0e-4adfb6e8f615 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.278437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 32/62] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:38.284079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547d95-e187-4b5b-8fb2-bd5348f0bd75 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.284545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547d95-e187-4b5b-8fb2-bd5348f0bd75 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.284616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547d95-e187-4b5b-8fb2-bd5348f0bd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.310918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e8547d95-e187-4b5b-8fb2-bd5348f0bd75 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:38.312122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e8547d95-e187-4b5b-8fb2-bd5348f0bd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:38.405672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 31/63] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:38.475976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07a60a-3298-4afb-9e68-8cfa5d174428 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.476270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07a60a-3298-4afb-9e68-8cfa5d174428 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.476531 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07a60a-3298-4afb-9e68-8cfa5d174428 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.477872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 33/64] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:38.484468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d1fa3-466b-4fea-b803-8f10ca65a45e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.485310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d1fa3-466b-4fea-b803-8f10ca65a45e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.486229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d1fa3-466b-4fea-b803-8f10ca65a45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.515290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8e6d1fa3-466b-4fea-b803-8f10ca65a45e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:38.517791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e6d1fa3-466b-4fea-b803-8f10ca65a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:38.608570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 32/65] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:38.628474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d6db9-e09f-4217-8c86-3488677a6fce None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.628756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d6db9-e09f-4217-8c86-3488677a6fce None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.629029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d6db9-e09f-4217-8c86-3488677a6fce None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.630372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 34/66] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:38.635584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000bd1c-88a5-4c55-91cf-f9f1c3071d39 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.635872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000bd1c-88a5-4c55-91cf-f9f1c3071d39 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.636153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000bd1c-88a5-4c55-91cf-f9f1c3071d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.663091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f000bd1c-88a5-4c55-91cf-f9f1c3071d39 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:38.664305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f000bd1c-88a5-4c55-91cf-f9f1c3071d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:38.688324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:38.749224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d6db9-e09f-4217-8c86-3488677a6fce None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:38.765785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 33/67] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:38.778251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:38.883474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d6db9-e09f-4217-8c86-3488677a6fce None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:38.911136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dfc7f-98ac-41cf-ab6c-c10b4be06c73 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.911439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dfc7f-98ac-41cf-ab6c-c10b4be06c73 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.911715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dfc7f-98ac-41cf-ab6c-c10b4be06c73 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.913328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 34/68] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:38.918946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bed62-8827-4d8c-889b-1c70a314bfcc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.919234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bed62-8827-4d8c-889b-1c70a314bfcc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.919515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bed62-8827-4d8c-889b-1c70a314bfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.939485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3aee3-6791-40c0-a9f0-fd7323e29df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:38.940123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3aee3-6791-40c0-a9f0-fd7323e29df6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.940406 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3aee3-6791-40c0-a9f0-fd7323e29df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.940680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3aee3-6791-40c0-a9f0-fd7323e29df6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.943816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-578bed62-8827-4d8c-889b-1c70a314bfcc None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:38.945197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-578bed62-8827-4d8c-889b-1c70a314bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:38.951542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3aee3-6791-40c0-a9f0-fd7323e29df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-09c3aee3-6791-40c0-a9f0-fd7323e29df6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:38.957065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:38.958120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:38.959119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:38.961376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 35/69] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:20:38.972187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3aee3-6791-40c0-a9f0-fd7323e29df6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.050160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.065795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 35/70] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:39.066941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bed62-8827-4d8c-889b-1c70a314bfcc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.077288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3aee3-6791-40c0-a9f0-fd7323e29df6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.142542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf82f2-251a-4b79-8dc8-3a481d7a44d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.143099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf82f2-251a-4b79-8dc8-3a481d7a44d2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.143379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf82f2-251a-4b79-8dc8-3a481d7a44d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.143649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf82f2-251a-4b79-8dc8-3a481d7a44d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.144321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf82f2-251a-4b79-8dc8-3a481d7a44d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.144677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf82f2-251a-4b79-8dc8-3a481d7a44d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.146066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf82f2-251a-4b79-8dc8-3a481d7a44d2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.164400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 36/71] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.165452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf82f2-251a-4b79-8dc8-3a481d7a44d2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.186427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.202478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bed62-8827-4d8c-889b-1c70a314bfcc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.239036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8f44-66fe-4854-8f8f-88c21e1544a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.239684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8f44-66fe-4854-8f8f-88c21e1544a5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.239978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8f44-66fe-4854-8f8f-88c21e1544a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.240254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8f44-66fe-4854-8f8f-88c21e1544a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.250652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc8f44-66fe-4854-8f8f-88c21e1544a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-accc8f44-66fe-4854-8f8f-88c21e1544a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:39.255503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:39.256324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:39.257089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 36/72] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:39.258178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ca008-f62f-4116-b95f-30e64c29e307 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.258464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ca008-f62f-4116-b95f-30e64c29e307 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.258761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ca008-f62f-4116-b95f-30e64c29e307 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.260110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 37/73] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:39.261018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ca008-f62f-4116-b95f-30e64c29e307 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.284033 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf82f2-251a-4b79-8dc8-3a481d7a44d2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.320174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e1944-af33-4d88-b2e7-a9ea9e01445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.320797 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e1944-af33-4d88-b2e7-a9ea9e01445a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.321076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e1944-af33-4d88-b2e7-a9ea9e01445a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.321347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e1944-af33-4d88-b2e7-a9ea9e01445a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.324283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.334651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e1944-af33-4d88-b2e7-a9ea9e01445a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-069e1944-af33-4d88-b2e7-a9ea9e01445a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:39.339494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:39.340395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:39.341145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 37/74] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:39.341755 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e1944-af33-4d88-b2e7-a9ea9e01445a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.376292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ca008-f62f-4116-b95f-30e64c29e307 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.410378 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fbb0b-d7b7-4c3a-a414-92c458a4ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.410969 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fbb0b-d7b7-4c3a-a414-92c458a4ec6e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.411255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fbb0b-d7b7-4c3a-a414-92c458a4ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.411529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fbb0b-d7b7-4c3a-a414-92c458a4ec6e None admin] PATH_INFO: `/v3/users/839a76c19ea54ec68f0ff11e282ae859` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.412665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fbb0b-d7b7-4c3a-a414-92c458a4ec6e None admin] RBAC: Authorizing `identity:get_user(user_id=839a76c19ea54ec68f0ff11e282ae859)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.414136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fbb0b-d7b7-4c3a-a414-92c458a4ec6e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.415752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 38/75] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/users/839a76c19ea54ec68f0ff11e282ae859 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.416846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcd2eb-f70c-4b6d-a439-4779d7d199ec None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.417131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcd2eb-f70c-4b6d-a439-4779d7d199ec None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.417403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcd2eb-f70c-4b6d-a439-4779d7d199ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.434751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-54bcd2eb-f70c-4b6d-a439-4779d7d199ec None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.435949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-54bcd2eb-f70c-4b6d-a439-4779d7d199ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.443975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.446276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e1944-af33-4d88-b2e7-a9ea9e01445a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.482405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27349ed-69fd-4339-bad6-dd7e524cd241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.483041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27349ed-69fd-4339-bad6-dd7e524cd241 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.483346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27349ed-69fd-4339-bad6-dd7e524cd241 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.483622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27349ed-69fd-4339-bad6-dd7e524cd241 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.484284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27349ed-69fd-4339-bad6-dd7e524cd241 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.484584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27349ed-69fd-4339-bad6-dd7e524cd241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.485974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27349ed-69fd-4339-bad6-dd7e524cd241 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.493891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 38/76] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.494705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27349ed-69fd-4339-bad6-dd7e524cd241 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.505202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 39/77] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:39.506065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcd2eb-f70c-4b6d-a439-4779d7d199ec None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.569224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.611928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcd2eb-f70c-4b6d-a439-4779d7d199ec None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.614027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27349ed-69fd-4339-bad6-dd7e524cd241 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.648807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360110e-a0ae-4933-a542-f21512cf47e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.649434 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360110e-a0ae-4933-a542-f21512cf47e0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.649664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e78877-b7e6-4151-a954-b55eabc3efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.649771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360110e-a0ae-4933-a542-f21512cf47e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.649973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360110e-a0ae-4933-a542-f21512cf47e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.650280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e78877-b7e6-4151-a954-b55eabc3efbb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.650563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e78877-b7e6-4151-a954-b55eabc3efbb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.650874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e78877-b7e6-4151-a954-b55eabc3efbb None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.651548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e78877-b7e6-4151-a954-b55eabc3efbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.652034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e78877-b7e6-4151-a954-b55eabc3efbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.653738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e78877-b7e6-4151-a954-b55eabc3efbb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.660111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360110e-a0ae-4933-a542-f21512cf47e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:39.663173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 40/78] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.664249 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e78877-b7e6-4151-a954-b55eabc3efbb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-9360110e-a0ae-4933-a542-f21512cf47e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:39.665916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:39.666801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:39.667564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:39.672059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 39/79] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:39.673185 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.673499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360110e-a0ae-4933-a542-f21512cf47e0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.771991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e78877-b7e6-4151-a954-b55eabc3efbb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.789592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360110e-a0ae-4933-a542-f21512cf47e0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.804594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f5dbf-9dcb-46ad-9bc5-12d74a6576b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.805198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f5dbf-9dcb-46ad-9bc5-12d74a6576b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.805477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f5dbf-9dcb-46ad-9bc5-12d74a6576b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.805748 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f5dbf-9dcb-46ad-9bc5-12d74a6576b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.807027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.825073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7fc32-42ad-42fe-b6ad-8fa10fe05416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.825702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7fc32-42ad-42fe-b6ad-8fa10fe05416 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.825988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7fc32-42ad-42fe-b6ad-8fa10fe05416 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.826267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7fc32-42ad-42fe-b6ad-8fa10fe05416 None admin] PATH_INFO: `/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.841354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7fc32-42ad-42fe-b6ad-8fa10fe05416 None admin] RBAC: Authorizing `identity:get_user(user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.842849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7fc32-42ad-42fe-b6ad-8fa10fe05416 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.844587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 40/80] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.844587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7fc32-42ad-42fe-b6ad-8fa10fe05416 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.879714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f5dbf-9dcb-46ad-9bc5-12d74a6576b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.881272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f5dbf-9dcb-46ad-9bc5-12d74a6576b7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.883885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.944909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7fc32-42ad-42fe-b6ad-8fa10fe05416 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.979001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3eba7-9f35-4846-8831-e48c6ea54ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.979587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 41/81] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:20:39.979711 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3eba7-9f35-4846-8831-e48c6ea54ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.979893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3eba7-9f35-4846-8831-e48c6ea54ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.980170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3eba7-9f35-4846-8831-e48c6ea54ff2 None admin] PATH_INFO: `/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.980437 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f5dbf-9dcb-46ad-9bc5-12d74a6576b7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.981382 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3eba7-9f35-4846-8831-e48c6ea54ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.982878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3eba7-9f35-4846-8831-e48c6ea54ff2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.985191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 41/82] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.985823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3eba7-9f35-4846-8831-e48c6ea54ff2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.030569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.078806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f5dbf-9dcb-46ad-9bc5-12d74a6576b7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.081370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.085579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3eba7-9f35-4846-8831-e48c6ea54ff2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.112829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f2c7b-0157-4d67-856b-1d97a021b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.113430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f2c7b-0157-4d67-856b-1d97a021b54f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.113718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f2c7b-0157-4d67-856b-1d97a021b54f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.113994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f2c7b-0157-4d67-856b-1d97a021b54f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.114649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f2c7b-0157-4d67-856b-1d97a021b54f None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:40.114979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f2c7b-0157-4d67-856b-1d97a021b54f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.116356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f2c7b-0157-4d67-856b-1d97a021b54f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.119042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65197-9dbe-428b-a2b4-3613d239a19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.119665 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65197-9dbe-428b-a2b4-3613d239a19b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.119948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65197-9dbe-428b-a2b4-3613d239a19b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.120223 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65197-9dbe-428b-a2b4-3613d239a19b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.121347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65197-9dbe-428b-a2b4-3613d239a19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.122802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65197-9dbe-428b-a2b4-3613d239a19b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.124067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 42/83] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:40.126718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 42/84] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:40.126836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f2c7b-0157-4d67-856b-1d97a021b54f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.126930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65197-9dbe-428b-a2b4-3613d239a19b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.223683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65197-9dbe-428b-a2b4-3613d239a19b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.227014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f2c7b-0157-4d67-856b-1d97a021b54f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.236375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.258197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3a243-ce39-4f30-9405-b8a0015adbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.258862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3a243-ce39-4f30-9405-b8a0015adbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.259146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3a243-ce39-4f30-9405-b8a0015adbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.259426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3a243-ce39-4f30-9405-b8a0015adbf5 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.260527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3a243-ce39-4f30-9405-b8a0015adbf5 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.260881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c3505-ff3f-4412-911e-ee0f53a8e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.261490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3505-ff3f-4412-911e-ee0f53a8e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.261775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3505-ff3f-4412-911e-ee0f53a8e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.261977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3a243-ce39-4f30-9405-b8a0015adbf5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.262068 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3505-ff3f-4412-911e-ee0f53a8e3a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.263645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 43/85] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:40.264402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3a243-ce39-4f30-9405-b8a0015adbf5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.297144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.332277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c3505-ff3f-4412-911e-ee0f53a8e3a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.333776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c3505-ff3f-4412-911e-ee0f53a8e3a4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.366967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3a243-ce39-4f30-9405-b8a0015adbf5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.400522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207efaf-375f-48ae-90b8-37616d09f493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.401125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207efaf-375f-48ae-90b8-37616d09f493 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.401411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207efaf-375f-48ae-90b8-37616d09f493 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.401691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207efaf-375f-48ae-90b8-37616d09f493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.433869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 43/86] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:20:40.434742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c3505-ff3f-4412-911e-ee0f53a8e3a4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.451160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.471782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207efaf-375f-48ae-90b8-37616d09f493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.473253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207efaf-375f-48ae-90b8-37616d09f493 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.500089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.535888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c3505-ff3f-4412-911e-ee0f53a8e3a4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.568319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff82211-6b55-4ab8-8898-cba9a92a0115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.568955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff82211-6b55-4ab8-8898-cba9a92a0115 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.569239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff82211-6b55-4ab8-8898-cba9a92a0115 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.569521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff82211-6b55-4ab8-8898-cba9a92a0115 None admin] PATH_INFO: `/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.570659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff82211-6b55-4ab8-8898-cba9a92a0115 None admin] RBAC: Authorizing `identity:get_user(user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.571138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 44/87] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:20:40.572174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff82211-6b55-4ab8-8898-cba9a92a0115 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.573761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 44/88] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:40.574761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff82211-6b55-4ab8-8898-cba9a92a0115 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.575018 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207efaf-375f-48ae-90b8-37616d09f493 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.655942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.677006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff82211-6b55-4ab8-8898-cba9a92a0115 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.677235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207efaf-375f-48ae-90b8-37616d09f493 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.711698 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75fa99-db93-4915-b20e-cd5f90ff9321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.712302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fa99-db93-4915-b20e-cd5f90ff9321 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.712582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fa99-db93-4915-b20e-cd5f90ff9321 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.712858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fa99-db93-4915-b20e-cd5f90ff9321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.713582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75fa99-db93-4915-b20e-cd5f90ff9321 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=8ec546be13a842489477e0212c390b7d, user.id=839a76c19ea54ec68f0ff11e282ae859) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:40.713679 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fce73-e606-4b1a-bc68-304e9b3e5183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.713893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75fa99-db93-4915-b20e-cd5f90ff9321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.714178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fce73-e606-4b1a-bc68-304e9b3e5183 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.714455 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fce73-e606-4b1a-bc68-304e9b3e5183 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.714761 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fce73-e606-4b1a-bc68-304e9b3e5183 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.715383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75fa99-db93-4915-b20e-cd5f90ff9321 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.715470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fce73-e606-4b1a-bc68-304e9b3e5183 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.716812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fce73-e606-4b1a-bc68-304e9b3e5183 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.717231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.725036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 45/89] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/role_assignments?user.id=839a76c19ea54ec68f0ff11e282ae859&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=946af2ff291349299db56e09aacb6b03 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:40.726179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75fa99-db93-4915-b20e-cd5f90ff9321 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.754909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 45/90] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:20:40 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.756383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fce73-e606-4b1a-bc68-304e9b3e5183 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.856868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75fa99-db93-4915-b20e-cd5f90ff9321 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.909318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432998-b8c6-4545-93cb-4d8d9e4bf620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.909978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432998-b8c6-4545-93cb-4d8d9e4bf620 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.910252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432998-b8c6-4545-93cb-4d8d9e4bf620 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.910525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432998-b8c6-4545-93cb-4d8d9e4bf620 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a432998-b8c6-4545-93cb-4d8d9e4bf620 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.913266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a432998-b8c6-4545-93cb-4d8d9e4bf620 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.914967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 46/91] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:40.915799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432998-b8c6-4545-93cb-4d8d9e4bf620 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.919037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fce73-e606-4b1a-bc68-304e9b3e5183 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.959913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1d5c-6fb6-49a9-ba30-e562cd9a2c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.960626 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1d5c-6fb6-49a9-ba30-e562cd9a2c48 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.960915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1d5c-6fb6-49a9-ba30-e562cd9a2c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.961201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1d5c-6fb6-49a9-ba30-e562cd9a2c48 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.962461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce1d5c-6fb6-49a9-ba30-e562cd9a2c48 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.964455 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce1d5c-6fb6-49a9-ba30-e562cd9a2c48 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.966544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 46/92] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:40.967348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1d5c-6fb6-49a9-ba30-e562cd9a2c48 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.974011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:41.009693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:41.056633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432998-b8c6-4545-93cb-4d8d9e4bf620 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.102993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e76c3-565e-4ebc-b15f-88a8503c11bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.103625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e76c3-565e-4ebc-b15f-88a8503c11bf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.104155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e76c3-565e-4ebc-b15f-88a8503c11bf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.104440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e76c3-565e-4ebc-b15f-88a8503c11bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.113680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1d5c-6fb6-49a9-ba30-e562cd9a2c48 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.162603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3c8ab-67fa-4c6c-81e0-2ca33451ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.163385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3c8ab-67fa-4c6c-81e0-2ca33451ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.163680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3c8ab-67fa-4c6c-81e0-2ca33451ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.163959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3c8ab-67fa-4c6c-81e0-2ca33451ccf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.164703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3c8ab-67fa-4c6c-81e0-2ca33451ccf2 None admin] RBAC: Adding query filter params (role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=8ec546be13a842489477e0212c390b7d, user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:41.165014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3c8ab-67fa-4c6c-81e0-2ca33451ccf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.166482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3c8ab-67fa-4c6c-81e0-2ca33451ccf2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.175866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 47/93] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/role_assignments?user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:41.176532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3c8ab-67fa-4c6c-81e0-2ca33451ccf2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.190534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e76c3-565e-4ebc-b15f-88a8503c11bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.192370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e76c3-565e-4ebc-b15f-88a8503c11bf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.263356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:41.284490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:41.331257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3c8ab-67fa-4c6c-81e0-2ca33451ccf2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.365439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 47/94] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:20:41.372143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e76c3-565e-4ebc-b15f-88a8503c11bf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.397363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378a205-bc6b-408e-bf9f-49065420067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.398893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378a205-bc6b-408e-bf9f-49065420067d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.399400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378a205-bc6b-408e-bf9f-49065420067d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.399866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378a205-bc6b-408e-bf9f-49065420067d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.400797 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378a205-bc6b-408e-bf9f-49065420067d None admin] RBAC: Adding query filter params (role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=8ec546be13a842489477e0212c390b7d, user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:41.401418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378a205-bc6b-408e-bf9f-49065420067d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.403208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378a205-bc6b-408e-bf9f-49065420067d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.410425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 48/95] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/role_assignments?user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:41.551960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e76c3-565e-4ebc-b15f-88a8503c11bf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.616308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7da9c-41a8-4161-a0e2-b3e3fedcc6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.616965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7da9c-41a8-4161-a0e2-b3e3fedcc6af None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.617250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7da9c-41a8-4161-a0e2-b3e3fedcc6af None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.617526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7da9c-41a8-4161-a0e2-b3e3fedcc6af None admin] PATH_INFO: `/v3/projects/5d83d8ba422a45ac96b81f068dbe494b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.618672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7da9c-41a8-4161-a0e2-b3e3fedcc6af None admin] RBAC: Authorizing `identity:get_project(project_id=5d83d8ba422a45ac96b81f068dbe494b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.620211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7da9c-41a8-4161-a0e2-b3e3fedcc6af None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.621912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 48/96] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/projects/5d83d8ba422a45ac96b81f068dbe494b => generated 312 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:41.629847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378a205-bc6b-408e-bf9f-49065420067d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.768247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378a205-bc6b-408e-bf9f-49065420067d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.799667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:41.810167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744ff98-6275-496c-8037-aaa71a723f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.811103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744ff98-6275-496c-8037-aaa71a723f9a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.811587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744ff98-6275-496c-8037-aaa71a723f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.812059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744ff98-6275-496c-8037-aaa71a723f9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.813594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744ff98-6275-496c-8037-aaa71a723f9a None admin] RBAC: Adding query filter params (role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=5d83d8ba422a45ac96b81f068dbe494b, user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:41.814319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744ff98-6275-496c-8037-aaa71a723f9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.816036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744ff98-6275-496c-8037-aaa71a723f9a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.822349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 49/97] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/role_assignments?user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4&scope.project.id=5d83d8ba422a45ac96b81f068dbe494b&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:43.588179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbb5a3-5754-4003-a791-05670a18effe None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.588742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbb5a3-5754-4003-a791-05670a18effe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.588742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbb5a3-5754-4003-a791-05670a18effe None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.590213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 49/98] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:43.604677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44f6bb-5bf3-4ea6-bab5-b06f96b9ea5c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.605190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44f6bb-5bf3-4ea6-bab5-b06f96b9ea5c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.605291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44f6bb-5bf3-4ea6-bab5-b06f96b9ea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.624284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ed44f6bb-5bf3-4ea6-bab5-b06f96b9ea5c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:43.625743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ed44f6bb-5bf3-4ea6-bab5-b06f96b9ea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:43.677094 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f825df-c5de-4edd-a860-4bbd3bfd304a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.677378 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f825df-c5de-4edd-a860-4bbd3bfd304a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.677654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f825df-c5de-4edd-a860-4bbd3bfd304a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.679272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 50/99] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:43.684760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd74d94-85ee-4405-b0c1-efd2dfaab0a1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.685267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd74d94-85ee-4405-b0c1-efd2dfaab0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.685735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd74d94-85ee-4405-b0c1-efd2dfaab0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.736913 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5bd74d94-85ee-4405-b0c1-efd2dfaab0a1 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:43.738123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5bd74d94-85ee-4405-b0c1-efd2dfaab0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:43.743111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 50/100] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:43.744211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd209-c806-4f81-a6d1-c625a6dc9ae8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.744500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd209-c806-4f81-a6d1-c625a6dc9ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.744775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd209-c806-4f81-a6d1-c625a6dc9ae8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.746023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 51/101] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:43.752118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabef4e4-aaf9-4de9-8f75-0d0d2e42165e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.752407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabef4e4-aaf9-4de9-8f75-0d0d2e42165e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.752684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabef4e4-aaf9-4de9-8f75-0d0d2e42165e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.778759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-aabef4e4-aaf9-4de9-8f75-0d0d2e42165e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:43.779957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-aabef4e4-aaf9-4de9-8f75-0d0d2e42165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:43.799710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:43.885215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 52/102] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:43.890131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee056ee-e9bb-4380-806b-a3a76ae2995b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.890429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee056ee-e9bb-4380-806b-a3a76ae2995b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.890721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee056ee-e9bb-4380-806b-a3a76ae2995b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.892133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 53/103] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:43.910476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a840f77-4346-4663-8f70-ec713c2ed7d0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.910905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a840f77-4346-4663-8f70-ec713c2ed7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.911187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a840f77-4346-4663-8f70-ec713c2ed7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.914974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 51/104] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:43.940673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2a840f77-4346-4663-8f70-ec713c2ed7d0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:43.941860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2a840f77-4346-4663-8f70-ec713c2ed7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:44.005691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:44.022412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 54/105] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:44.195950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd74d94-85ee-4405-b0c1-efd2dfaab0a1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.295080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a840f77-4346-4663-8f70-ec713c2ed7d0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.339270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd74d94-85ee-4405-b0c1-efd2dfaab0a1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.400954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a840f77-4346-4663-8f70-ec713c2ed7d0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.404209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64be69-7655-4d82-9537-4b0229e8fa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.405067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64be69-7655-4d82-9537-4b0229e8fa20 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.405496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64be69-7655-4d82-9537-4b0229e8fa20 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.405911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64be69-7655-4d82-9537-4b0229e8fa20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.433354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64be69-7655-4d82-9537-4b0229e8fa20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5b64be69-7655-4d82-9537-4b0229e8fa20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:44.438919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:44.439770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:44.440508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 52/106] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:44.441125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64be69-7655-4d82-9537-4b0229e8fa20 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.442919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79777e66-d6ac-4183-aa0e-a76b914cf6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.443558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79777e66-d6ac-4183-aa0e-a76b914cf6ba None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.443834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79777e66-d6ac-4183-aa0e-a76b914cf6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.444104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79777e66-d6ac-4183-aa0e-a76b914cf6ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.456782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79777e66-d6ac-4183-aa0e-a76b914cf6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-79777e66-d6ac-4183-aa0e-a76b914cf6ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:44.461940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:44.463016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:44.463773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:44.466062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 55/107] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:20:44.467082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79777e66-d6ac-4183-aa0e-a76b914cf6ba None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.482266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:44.523848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:44.582429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64be69-7655-4d82-9537-4b0229e8fa20 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.583649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79777e66-d6ac-4183-aa0e-a76b914cf6ba None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.630402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832b15d-fd8f-42ff-a1ec-830af967eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.631113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832b15d-fd8f-42ff-a1ec-830af967eee0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.631363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832b15d-fd8f-42ff-a1ec-830af967eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.631606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832b15d-fd8f-42ff-a1ec-830af967eee0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.632404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4ab68-76d3-4d6d-94f6-d52e8a2086ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.633542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4ab68-76d3-4d6d-94f6-d52e8a2086ab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.634018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4ab68-76d3-4d6d-94f6-d52e8a2086ab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.634488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4ab68-76d3-4d6d-94f6-d52e8a2086ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.635878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4ab68-76d3-4d6d-94f6-d52e8a2086ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.637903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4ab68-76d3-4d6d-94f6-d52e8a2086ab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.644724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832b15d-fd8f-42ff-a1ec-830af967eee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:44.644988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 53/108] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:44.646029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4ab68-76d3-4d6d-94f6-d52e8a2086ab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3832b15d-fd8f-42ff-a1ec-830af967eee0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:44.647619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:44.648461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:44.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 56/109] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:44.649888 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832b15d-fd8f-42ff-a1ec-830af967eee0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.757028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832b15d-fd8f-42ff-a1ec-830af967eee0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.757923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:44.765214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:44.768485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4ab68-76d3-4d6d-94f6-d52e8a2086ab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.794795 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5a592-9927-412d-93c3-25fd89727d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.795403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a592-9927-412d-93c3-25fd89727d34 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.795685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a592-9927-412d-93c3-25fd89727d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.795957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a592-9927-412d-93c3-25fd89727d34 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.796618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5a592-9927-412d-93c3-25fd89727d34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:44.796918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5a592-9927-412d-93c3-25fd89727d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.798946 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5a592-9927-412d-93c3-25fd89727d34 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.806872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d52ee-426f-446f-a618-5fe1114cdba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.807487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d52ee-426f-446f-a618-5fe1114cdba9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.807959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d52ee-426f-446f-a618-5fe1114cdba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.808061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 57/110] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:44.808562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5a592-9927-412d-93c3-25fd89727d34 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.813184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d52ee-426f-446f-a618-5fe1114cdba9 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.813899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d52ee-426f-446f-a618-5fe1114cdba9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:44.814213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d52ee-426f-446f-a618-5fe1114cdba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.815642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d52ee-426f-446f-a618-5fe1114cdba9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.830550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 54/111] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:44.830550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d52ee-426f-446f-a618-5fe1114cdba9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.915963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5a592-9927-412d-93c3-25fd89727d34 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.928224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d52ee-426f-446f-a618-5fe1114cdba9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.950113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921a24c-135e-4047-a0c8-e9d2e661da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.950755 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a24c-135e-4047-a0c8-e9d2e661da7a None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.951046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a24c-135e-4047-a0c8-e9d2e661da7a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.951323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a24c-135e-4047-a0c8-e9d2e661da7a None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.951970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921a24c-135e-4047-a0c8-e9d2e661da7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.953464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921a24c-135e-4047-a0c8-e9d2e661da7a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.960979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e03682-b529-41b3-be15-e21378eb25cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.961582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e03682-b529-41b3-be15-e21378eb25cd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.961862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e03682-b529-41b3-be15-e21378eb25cd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.962141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e03682-b529-41b3-be15-e21378eb25cd None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.962843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e03682-b529-41b3-be15-e21378eb25cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:44.963146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e03682-b529-41b3-be15-e21378eb25cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.964528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e03682-b529-41b3-be15-e21378eb25cd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.973543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 55/112] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:44.974927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f5ea-1786-4e8c-81a9-fb9a5e2d2961 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.975257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f5ea-1786-4e8c-81a9-fb9a5e2d2961 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.975543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f5ea-1786-4e8c-81a9-fb9a5e2d2961 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.977903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 56/113] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:44.977903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46f5ea-1786-4e8c-81a9-fb9a5e2d2961 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.983450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 58/114] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:20:44 2022] POST /identity/v3/projects => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:44.984282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921a24c-135e-4047-a0c8-e9d2e661da7a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.997941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.021227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.097979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46f5ea-1786-4e8c-81a9-fb9a5e2d2961 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.115859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921a24c-135e-4047-a0c8-e9d2e661da7a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.137902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95088-e743-46a9-96cc-5bc63238eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:45.138482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95088-e743-46a9-96cc-5bc63238eb18 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.138796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95088-e743-46a9-96cc-5bc63238eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.139074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95088-e743-46a9-96cc-5bc63238eb18 None admin] PATH_INFO: `/v3/users/839a76c19ea54ec68f0ff11e282ae859` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.140208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad95088-e743-46a9-96cc-5bc63238eb18 None admin] RBAC: Authorizing `identity:get_user(user_id=839a76c19ea54ec68f0ff11e282ae859)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.141835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad95088-e743-46a9-96cc-5bc63238eb18 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.143581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 57/115] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/users/839a76c19ea54ec68f0ff11e282ae859 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:45.148194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23453c-b30f-4524-a32f-01fd98c556f0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.148194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23453c-b30f-4524-a32f-01fd98c556f0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.148194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23453c-b30f-4524-a32f-01fd98c556f0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.148194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 58/116] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:45.148194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23453c-b30f-4524-a32f-01fd98c556f0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:45.160976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796d956-480f-4cc2-8ce5-29d3bbb5d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:45.161620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796d956-480f-4cc2-8ce5-29d3bbb5d300 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.161906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796d956-480f-4cc2-8ce5-29d3bbb5d300 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.162180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796d956-480f-4cc2-8ce5-29d3bbb5d300 None admin] PATH_INFO: `/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.164000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796d956-480f-4cc2-8ce5-29d3bbb5d300 None admin] RBAC: Authorizing `identity:get_user(user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.164847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796d956-480f-4cc2-8ce5-29d3bbb5d300 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.166455 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 59/117] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:45.168317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dbdb2-cf4e-43e2-bc1b-3024134744bc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.168600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dbdb2-cf4e-43e2-bc1b-3024134744bc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.168876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dbdb2-cf4e-43e2-bc1b-3024134744bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.187418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3f0dbdb2-cf4e-43e2-bc1b-3024134744bc None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:45.188663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3f0dbdb2-cf4e-43e2-bc1b-3024134744bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:45.240074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.258639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23453c-b30f-4524-a32f-01fd98c556f0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.266435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 60/118] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:45.267488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0dbdb2-cf4e-43e2-bc1b-3024134744bc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:45.293156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.304230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30562491-3393-49c1-a5d3-001eda5b21df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:45.304991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30562491-3393-49c1-a5d3-001eda5b21df None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.305285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30562491-3393-49c1-a5d3-001eda5b21df None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.305566 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30562491-3393-49c1-a5d3-001eda5b21df None admin] PATH_INFO: `/v3/users/dbdfd06d8c164b6bbee854095a9de4ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.321120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30562491-3393-49c1-a5d3-001eda5b21df None admin] RBAC: Authorizing `identity:get_user(user_id=dbdfd06d8c164b6bbee854095a9de4ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.322828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30562491-3393-49c1-a5d3-001eda5b21df None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.325004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 59/119] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:45 2022] GET /identity/v3/users/dbdfd06d8c164b6bbee854095a9de4ae => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:45.326273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f325eea-cad3-4715-a356-17aa6e175b85 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.326561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f325eea-cad3-4715-a356-17aa6e175b85 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.326882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f325eea-cad3-4715-a356-17aa6e175b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.352024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7f325eea-cad3-4715-a356-17aa6e175b85 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:45.353442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7f325eea-cad3-4715-a356-17aa6e175b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:45.408465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0dbdb2-cf4e-43e2-bc1b-3024134744bc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.445352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0427200-e420-44fd-8498-0492f6b24759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:45.446008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0427200-e420-44fd-8498-0492f6b24759 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.446264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0427200-e420-44fd-8498-0492f6b24759 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.446655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 60/120] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:45.447852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0427200-e420-44fd-8498-0492f6b24759 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.448081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f325eea-cad3-4715-a356-17aa6e175b85 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:45.454028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0427200-e420-44fd-8498-0492f6b24759 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.455677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0427200-e420-44fd-8498-0492f6b24759 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.457688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 61/121] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:45 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:45.463009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0427200-e420-44fd-8498-0492f6b24759 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:45.532735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.571750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f325eea-cad3-4715-a356-17aa6e175b85 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.599231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.615020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0427200-e420-44fd-8498-0492f6b24759 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.621489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44fee5-f465-45b8-861e-f09626c8bbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:45.622934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44fee5-f465-45b8-861e-f09626c8bbaf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.623443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44fee5-f465-45b8-861e-f09626c8bbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.623923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44fee5-f465-45b8-861e-f09626c8bbaf None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.626299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44fee5-f465-45b8-861e-f09626c8bbaf None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.628572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44fee5-f465-45b8-861e-f09626c8bbaf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.631317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 61/122] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:45 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:45.632296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44fee5-f465-45b8-861e-f09626c8bbaf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:45.651435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f343-027c-4dd8-a1ff-5ecd15dd7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:45.652065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f343-027c-4dd8-a1ff-5ecd15dd7bff None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.652264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f343-027c-4dd8-a1ff-5ecd15dd7bff None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.652534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f343-027c-4dd8-a1ff-5ecd15dd7bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.732232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6f343-027c-4dd8-a1ff-5ecd15dd7bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.733788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6f343-027c-4dd8-a1ff-5ecd15dd7bff None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.767853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44fee5-f465-45b8-861e-f09626c8bbaf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.808824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565632a1-f938-4b03-b2fb-048bdf32cac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:45.809479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565632a1-f938-4b03-b2fb-048bdf32cac4 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.809767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565632a1-f938-4b03-b2fb-048bdf32cac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.810041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565632a1-f938-4b03-b2fb-048bdf32cac4 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d/users/839a76c19ea54ec68f0ff11e282ae859/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.811968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565632a1-f938-4b03-b2fb-048bdf32cac4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ec546be13a842489477e0212c390b7d, user_id=839a76c19ea54ec68f0ff11e282ae859, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.814410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565632a1-f938-4b03-b2fb-048bdf32cac4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.827331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.827874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.832487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 62/123] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:20:45 2022] PUT /identity/v3/projects/8ec546be13a842489477e0212c390b7d/users/839a76c19ea54ec68f0ff11e282ae859/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:45.844355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565632a1-f938-4b03-b2fb-048bdf32cac4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:45.856091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 62/124] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:20:45.857277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f343-027c-4dd8-a1ff-5ecd15dd7bff None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:45.973863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f343-027c-4dd8-a1ff-5ecd15dd7bff None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.990160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565632a1-f938-4b03-b2fb-048bdf32cac4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:46.018663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a384b-1957-428c-a30d-17e23a1e091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.020035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a384b-1957-428c-a30d-17e23a1e091e None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.020313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a384b-1957-428c-a30d-17e23a1e091e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.020589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a384b-1957-428c-a30d-17e23a1e091e None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.022538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a384b-1957-428c-a30d-17e23a1e091e None admin] RBAC: Authorizing `identity:create_grant(project_id=8ec546be13a842489477e0212c390b7d, user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:46.024140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a384b-1957-428c-a30d-17e23a1e091e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:46.036476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075c712-b806-4ab0-81dd-260c4fe1fc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.037116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075c712-b806-4ab0-81dd-260c4fe1fc3f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.037458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075c712-b806-4ab0-81dd-260c4fe1fc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.038554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075c712-b806-4ab0-81dd-260c4fe1fc3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.044871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 63/125] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:20:45 2022] PUT /identity/v3/projects/8ec546be13a842489477e0212c390b7d/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:46.045505 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a384b-1957-428c-a30d-17e23a1e091e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:46.054713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075c712-b806-4ab0-81dd-260c4fe1fc3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0075c712-b806-4ab0-81dd-260c4fe1fc3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:46.063475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:46.064522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:46.065288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 63/126] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:20:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:46.070826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075c712-b806-4ab0-81dd-260c4fe1fc3f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:46.119192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:46.191898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:46.246411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a384b-1957-428c-a30d-17e23a1e091e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:46.253808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075c712-b806-4ab0-81dd-260c4fe1fc3f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:46.297920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b8306-2aa2-46c4-bb51-7a6d15e44fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.298568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b8306-2aa2-46c4-bb51-7a6d15e44fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.298979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b8306-2aa2-46c4-bb51-7a6d15e44fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.301393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b8306-2aa2-46c4-bb51-7a6d15e44fd7 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.304168 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b8306-2aa2-46c4-bb51-7a6d15e44fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:46.305677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b8306-2aa2-46c4-bb51-7a6d15e44fd7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:46.309827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 64/127] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:46 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:46.310637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b8306-2aa2-46c4-bb51-7a6d15e44fd7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:46.312517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd113397-2a4a-4f40-b19a-9f17f1f615c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.313756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd113397-2a4a-4f40-b19a-9f17f1f615c0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.314084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd113397-2a4a-4f40-b19a-9f17f1f615c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.314369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd113397-2a4a-4f40-b19a-9f17f1f615c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.336837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd113397-2a4a-4f40-b19a-9f17f1f615c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fd113397-2a4a-4f40-b19a-9f17f1f615c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:46.342726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:46.343580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:46.344850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 64/128] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:46.347561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd113397-2a4a-4f40-b19a-9f17f1f615c0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:46.486809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd113397-2a4a-4f40-b19a-9f17f1f615c0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:46.495989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:46.529521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaac4d7-86d5-4693-8cd7-2aa2abdb697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.530132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaac4d7-86d5-4693-8cd7-2aa2abdb697f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.530465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaac4d7-86d5-4693-8cd7-2aa2abdb697f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.530783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaac4d7-86d5-4693-8cd7-2aa2abdb697f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.532083 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaac4d7-86d5-4693-8cd7-2aa2abdb697f None admin] RBAC: Adding query filter params (role.id=749cda9c1c1448eeba2fa484424d0b15, scope.project.id=8ec546be13a842489477e0212c390b7d, user.id=dbdfd06d8c164b6bbee854095a9de4ae) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:46.532400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaac4d7-86d5-4693-8cd7-2aa2abdb697f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:46.534005 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaac4d7-86d5-4693-8cd7-2aa2abdb697f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:46.540006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 65/129] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:46 2022] GET /identity/v3/role_assignments?user.id=dbdfd06d8c164b6bbee854095a9de4ae&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=749cda9c1c1448eeba2fa484424d0b15 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:46.540805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaac4d7-86d5-4693-8cd7-2aa2abdb697f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:46.541157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b8306-2aa2-46c4-bb51-7a6d15e44fd7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:46.612211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:46.626859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cf409-f269-4722-9983-23c528473b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.628414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cf409-f269-4722-9983-23c528473b11 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.629013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cf409-f269-4722-9983-23c528473b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.632138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cf409-f269-4722-9983-23c528473b11 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.633083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cf409-f269-4722-9983-23c528473b11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:46.633776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cf409-f269-4722-9983-23c528473b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:46.636720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cf409-f269-4722-9983-23c528473b11 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:46.659666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 65/130] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:20:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:46.684152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cf409-f269-4722-9983-23c528473b11 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:46.701580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaac4d7-86d5-4693-8cd7-2aa2abdb697f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:46.746048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be55bf1-e22b-419c-a280-2c61f0e8fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.747005 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be55bf1-e22b-419c-a280-2c61f0e8fb26 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.747510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be55bf1-e22b-419c-a280-2c61f0e8fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.747981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be55bf1-e22b-419c-a280-2c61f0e8fb26 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.748849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be55bf1-e22b-419c-a280-2c61f0e8fb26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:46.749351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be55bf1-e22b-419c-a280-2c61f0e8fb26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:46.751057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be55bf1-e22b-419c-a280-2c61f0e8fb26 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:46.760831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 66/131] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:46.767613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be55bf1-e22b-419c-a280-2c61f0e8fb26 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:46.808140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:46.869197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cf409-f269-4722-9983-23c528473b11 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:46.925915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be55bf1-e22b-419c-a280-2c61f0e8fb26 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:46.942605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff98f3-3e42-49df-8963-f09553c0b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.943385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff98f3-3e42-49df-8963-f09553c0b001 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.943822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff98f3-3e42-49df-8963-f09553c0b001 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.944242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff98f3-3e42-49df-8963-f09553c0b001 None admin] PATH_INFO: `/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.950651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff98f3-3e42-49df-8963-f09553c0b001 None admin] RBAC: Authorizing `identity:get_user(user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:46.952393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff98f3-3e42-49df-8963-f09553c0b001 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:46.955141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 66/132] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:46 2022] GET /identity/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:46.960912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff98f3-3e42-49df-8963-f09553c0b001 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:46.965964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3c80-d6e0-46bf-940e-172758b8bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.967720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3c80-d6e0-46bf-940e-172758b8bb4d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.968245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3c80-d6e0-46bf-940e-172758b8bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.968744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3c80-d6e0-46bf-940e-172758b8bb4d None admin] PATH_INFO: `/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.970842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae3c80-d6e0-46bf-940e-172758b8bb4d None admin] RBAC: Authorizing `identity:get_user(user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:46.972515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae3c80-d6e0-46bf-940e-172758b8bb4d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:46.974702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 67/133] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:46 2022] GET /identity/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:46.979859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3c80-d6e0-46bf-940e-172758b8bb4d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:47.039354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:47.088930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff98f3-3e42-49df-8963-f09553c0b001 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:47.127197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f06d2-28ec-4762-9723-b79889e423a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:47.128191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f06d2-28ec-4762-9723-b79889e423a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:47.128752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f06d2-28ec-4762-9723-b79889e423a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:47.129251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f06d2-28ec-4762-9723-b79889e423a9 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:47.131389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f06d2-28ec-4762-9723-b79889e423a9 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:47.132942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f06d2-28ec-4762-9723-b79889e423a9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:47.134837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 67/134] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:46 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:47.135975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acfd6-eacb-42d5-a353-f3ce594be68b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:47.136359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acfd6-eacb-42d5-a353-f3ce594be68b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:47.136709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acfd6-eacb-42d5-a353-f3ce594be68b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:47.138005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 68/135] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:47.143892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acfd6-eacb-42d5-a353-f3ce594be68b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:47.264790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:47.266618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acfd6-eacb-42d5-a353-f3ce594be68b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:47.268976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3c80-d6e0-46bf-940e-172758b8bb4d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:47.303473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:47.306170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968de1fc-1c87-4c9b-ba98-4ffe1e9b1684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:47.306933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968de1fc-1c87-4c9b-ba98-4ffe1e9b1684 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:47.307227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968de1fc-1c87-4c9b-ba98-4ffe1e9b1684 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:47.307694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968de1fc-1c87-4c9b-ba98-4ffe1e9b1684 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4/roles/d48e46bf2b814100a25f94d5cdffecfd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:47.309946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968de1fc-1c87-4c9b-ba98-4ffe1e9b1684 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ec546be13a842489477e0212c390b7d, user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4, role_id=d48e46bf2b814100a25f94d5cdffecfd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:47.311644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968de1fc-1c87-4c9b-ba98-4ffe1e9b1684 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:47.340611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f2b46-7048-428d-80d8-2c05b623d636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:47.341652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f2b46-7048-428d-80d8-2c05b623d636 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:47.341983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f2b46-7048-428d-80d8-2c05b623d636 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:47.342407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f2b46-7048-428d-80d8-2c05b623d636 None admin] PATH_INFO: `/v3/projects/5d83d8ba422a45ac96b81f068dbe494b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:47.343645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f2b46-7048-428d-80d8-2c05b623d636 None admin] RBAC: Authorizing `identity:get_project(project_id=5d83d8ba422a45ac96b81f068dbe494b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:47.344054 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 69/136] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:20:47 2022] PUT /identity/v3/projects/8ec546be13a842489477e0212c390b7d/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4/roles/d48e46bf2b814100a25f94d5cdffecfd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:47.345804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7587758-643d-4015-9ea8-444ad59d2a12 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:47.346024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f2b46-7048-428d-80d8-2c05b623d636 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:47.346488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7587758-643d-4015-9ea8-444ad59d2a12 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:47.346977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7587758-643d-4015-9ea8-444ad59d2a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:47.347814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 68/137] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:46 2022] GET /identity/v3/projects/5d83d8ba422a45ac96b81f068dbe494b => generated 312 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:47.356194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f2b46-7048-428d-80d8-2c05b623d636 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:47.385269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f7587758-643d-4015-9ea8-444ad59d2a12 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:47.386850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f7587758-643d-4015-9ea8-444ad59d2a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:47.467138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 70/138] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:47.585617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f2b46-7048-428d-80d8-2c05b623d636 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:47.621759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf439b-5c7a-40aa-b2b6-06d52e704bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:47.622427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf439b-5c7a-40aa-b2b6-06d52e704bb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:47.622730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf439b-5c7a-40aa-b2b6-06d52e704bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:47.623108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf439b-5c7a-40aa-b2b6-06d52e704bb6 None admin] PATH_INFO: `/v3/projects/5d83d8ba422a45ac96b81f068dbe494b/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:47.625578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf439b-5c7a-40aa-b2b6-06d52e704bb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d83d8ba422a45ac96b81f068dbe494b, user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:47.627065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf439b-5c7a-40aa-b2b6-06d52e704bb6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:47.645428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 69/139] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:20:47 2022] PUT /identity/v3/projects/5d83d8ba422a45ac96b81f068dbe494b/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:47.815888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7587758-643d-4015-9ea8-444ad59d2a12 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:47.940964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7587758-643d-4015-9ea8-444ad59d2a12 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:47.958796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:47.979937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdd566-3488-4f08-becf-c936720a232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:47.980583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd566-3488-4f08-becf-c936720a232c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:47.980867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd566-3488-4f08-becf-c936720a232c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:47.981265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd566-3488-4f08-becf-c936720a232c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:47.983351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdd566-3488-4f08-becf-c936720a232c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:47.985542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdd566-3488-4f08-becf-c936720a232c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:47.987345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 71/140] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:47.992986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf439b-5c7a-40aa-b2b6-06d52e704bb6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:48.051903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:48.146717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf439b-5c7a-40aa-b2b6-06d52e704bb6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:48.193881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22cf65-8975-4d5d-9739-0ab9d1c2603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:48.194412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22cf65-8975-4d5d-9739-0ab9d1c2603e None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:48.194711 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22cf65-8975-4d5d-9739-0ab9d1c2603e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:48.195003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22cf65-8975-4d5d-9739-0ab9d1c2603e None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:48.195663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22cf65-8975-4d5d-9739-0ab9d1c2603e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:48.197104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22cf65-8975-4d5d-9739-0ab9d1c2603e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:48.219394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 70/141] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:20:47 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:48.748940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d1d72-ac9e-4e0c-9628-0b1da6f0c6c6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:48.749500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d1d72-ac9e-4e0c-9628-0b1da6f0c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:48.749949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d1d72-ac9e-4e0c-9628-0b1da6f0c6c6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:48.752199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 72/142] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:48.757585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef40bb-1b89-4f17-8d03-921ab66276e0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:48.758085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef40bb-1b89-4f17-8d03-921ab66276e0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:48.758534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef40bb-1b89-4f17-8d03-921ab66276e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:48.779915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-43ef40bb-1b89-4f17-8d03-921ab66276e0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:48.781386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-43ef40bb-1b89-4f17-8d03-921ab66276e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:48.865251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 71/143] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:49.143572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0330-dbf0-4830-9d47-55fc0cd9593d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:49.144604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0330-dbf0-4830-9d47-55fc0cd9593d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:49.145096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0330-dbf0-4830-9d47-55fc0cd9593d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:49.146670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 73/144] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:49.152398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4323e7-cb0f-484d-b1c5-a275cd20e9bb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:49.153225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4323e7-cb0f-484d-b1c5-a275cd20e9bb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:49.153701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4323e7-cb0f-484d-b1c5-a275cd20e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:49.176181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7f4323e7-cb0f-484d-b1c5-a275cd20e9bb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:49.177708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7f4323e7-cb0f-484d-b1c5-a275cd20e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:49.187999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:49.237918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814bb18-d9fb-41bc-8ec4-be2e4cbdfd75 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:49.238212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814bb18-d9fb-41bc-8ec4-be2e4cbdfd75 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:49.238470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814bb18-d9fb-41bc-8ec4-be2e4cbdfd75 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:49.239992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 74/145] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:20:49.245738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6f1e-d2a9-4361-aed7-1553e0c20b56 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:49.246023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6f1e-d2a9-4361-aed7-1553e0c20b56 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:49.246298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6f1e-d2a9-4361-aed7-1553e0c20b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:49.265571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 72/146] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:49.282582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2b5a6f1e-d2a9-4361-aed7-1553e0c20b56 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:49.283819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b5a6f1e-d2a9-4361-aed7-1553e0c20b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:49.307489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4323e7-cb0f-484d-b1c5-a275cd20e9bb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:49.403552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 75/147] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:49.436828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4323e7-cb0f-484d-b1c5-a275cd20e9bb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:49.478200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb8db-6663-4e8b-b1ab-79cc7f227c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:49.478930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb8db-6663-4e8b-b1ab-79cc7f227c7e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:49.479207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb8db-6663-4e8b-b1ab-79cc7f227c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:49.479476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb8db-6663-4e8b-b1ab-79cc7f227c7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:49.490101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb8db-6663-4e8b-b1ab-79cc7f227c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-420bb8db-6663-4e8b-b1ab-79cc7f227c7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:49.495175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:49.495999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:49.497143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 73/148] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:20:49.502810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a6f1e-d2a9-4361-aed7-1553e0c20b56 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:49.630788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a6f1e-d2a9-4361-aed7-1553e0c20b56 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:49.650222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:49.679019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc9e01-b247-44e2-b2ca-8cb05116026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:49.679641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc9e01-b247-44e2-b2ca-8cb05116026e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:49.679921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc9e01-b247-44e2-b2ca-8cb05116026e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:49.680193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc9e01-b247-44e2-b2ca-8cb05116026e None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:49.680863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc9e01-b247-44e2-b2ca-8cb05116026e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:49.681167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc9e01-b247-44e2-b2ca-8cb05116026e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:49.682559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc9e01-b247-44e2-b2ca-8cb05116026e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:49.696865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 76/149] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:49.702408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb8db-6663-4e8b-b1ab-79cc7f227c7e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:49.717530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:49.752682 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc9e01-b247-44e2-b2ca-8cb05116026e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:49.828805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb8db-6663-4e8b-b1ab-79cc7f227c7e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:49.868920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9881d-70a7-4d75-8d78-fa0e7162ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:49.869778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9881d-70a7-4d75-8d78-fa0e7162ed60 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:49.870314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9881d-70a7-4d75-8d78-fa0e7162ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:49.870813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9881d-70a7-4d75-8d78-fa0e7162ed60 None admin] PATH_INFO: `/v3/users/839a76c19ea54ec68f0ff11e282ae859` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:49.872155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9881d-70a7-4d75-8d78-fa0e7162ed60 None admin] RBAC: Authorizing `identity:get_user(user_id=839a76c19ea54ec68f0ff11e282ae859)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:49.873989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9881d-70a7-4d75-8d78-fa0e7162ed60 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:49.876780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 74/150] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:49 2022] GET /identity/v3/users/839a76c19ea54ec68f0ff11e282ae859 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:49.882819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9881d-70a7-4d75-8d78-fa0e7162ed60 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:49.895103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc9e01-b247-44e2-b2ca-8cb05116026e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:49.964066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:49.971466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288ac3-161b-42d8-85c9-81892e70e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:49.972134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288ac3-161b-42d8-85c9-81892e70e949 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:49.972417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288ac3-161b-42d8-85c9-81892e70e949 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:49.972934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288ac3-161b-42d8-85c9-81892e70e949 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:49.995919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5288ac3-161b-42d8-85c9-81892e70e949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:49.997715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9881d-70a7-4d75-8d78-fa0e7162ed60 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c5288ac3-161b-42d8-85c9-81892e70e949 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:50.003646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:50.004514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:50.005268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:50.009458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 77/151] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:50.010619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288ac3-161b-42d8-85c9-81892e70e949 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:50.047627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427baf2-ef8d-4a53-ad41-d72e6a4c7cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:50.048612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427baf2-ef8d-4a53-ad41-d72e6a4c7cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.049094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427baf2-ef8d-4a53-ad41-d72e6a4c7cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.049563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427baf2-ef8d-4a53-ad41-d72e6a4c7cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.077003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:50.135230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427baf2-ef8d-4a53-ad41-d72e6a4c7cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:50.137052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427baf2-ef8d-4a53-ad41-d72e6a4c7cd2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:50.161364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288ac3-161b-42d8-85c9-81892e70e949 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:50.199614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72264374-0e63-4f75-9389-3498d726a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:50.200633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72264374-0e63-4f75-9389-3498d726a5ea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.201104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72264374-0e63-4f75-9389-3498d726a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.201571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72264374-0e63-4f75-9389-3498d726a5ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.214561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72264374-0e63-4f75-9389-3498d726a5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-72264374-0e63-4f75-9389-3498d726a5ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:50.221585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:50.222456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:20:50.223235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:50.223801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:50.226020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 78/152] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:50.227246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72264374-0e63-4f75-9389-3498d726a5ea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:50.247788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 75/153] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:20:50.248821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427baf2-ef8d-4a53-ad41-d72e6a4c7cd2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:50.342712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:50.347079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72264374-0e63-4f75-9389-3498d726a5ea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:50.403430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45d5e3-3e62-42cc-9a21-fdbef39e352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:50.404056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45d5e3-3e62-42cc-9a21-fdbef39e352c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.404343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45d5e3-3e62-42cc-9a21-fdbef39e352c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.404618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45d5e3-3e62-42cc-9a21-fdbef39e352c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.405305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45d5e3-3e62-42cc-9a21-fdbef39e352c None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:50.405610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45d5e3-3e62-42cc-9a21-fdbef39e352c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:50.405816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427baf2-ef8d-4a53-ad41-d72e6a4c7cd2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:50.407635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45d5e3-3e62-42cc-9a21-fdbef39e352c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:50.427907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 79/154] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:50.428835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45d5e3-3e62-42cc-9a21-fdbef39e352c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:50.476124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0cb3f-beb6-4799-9d34-18f709cffa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:50.476986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0cb3f-beb6-4799-9d34-18f709cffa05 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.477412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0cb3f-beb6-4799-9d34-18f709cffa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.477826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0cb3f-beb6-4799-9d34-18f709cffa05 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.478640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0cb3f-beb6-4799-9d34-18f709cffa05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:50.479102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0cb3f-beb6-4799-9d34-18f709cffa05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:50.480661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0cb3f-beb6-4799-9d34-18f709cffa05 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:50.495046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 76/155] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:50.496471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2077d-7db3-4b76-809f-0e63f82aab89 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.496910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2077d-7db3-4b76-809f-0e63f82aab89 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.497327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2077d-7db3-4b76-809f-0e63f82aab89 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.498725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 77/156] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:50.499560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2077d-7db3-4b76-809f-0e63f82aab89 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:50.570709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:50.610996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45d5e3-3e62-42cc-9a21-fdbef39e352c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:50.683377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2077d-7db3-4b76-809f-0e63f82aab89 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:50.699328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17323-08b4-4438-99de-c9e52567bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:50.700119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17323-08b4-4438-99de-c9e52567bd74 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.700493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17323-08b4-4438-99de-c9e52567bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.701023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17323-08b4-4438-99de-c9e52567bd74 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.702413 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17323-08b4-4438-99de-c9e52567bd74 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:50.704903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17323-08b4-4438-99de-c9e52567bd74 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:50.710954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 80/157] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:50 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:50.711996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17323-08b4-4438-99de-c9e52567bd74 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:50.766002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1117e10-e47b-449a-b499-0c1b7ce8bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:50.766704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1117e10-e47b-449a-b499-0c1b7ce8bd39 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.767297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1117e10-e47b-449a-b499-0c1b7ce8bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.767585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1117e10-e47b-449a-b499-0c1b7ce8bd39 None admin] PATH_INFO: `/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.771042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:50.771683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1117e10-e47b-449a-b499-0c1b7ce8bd39 None admin] RBAC: Authorizing `identity:get_user(user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:50.773153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1117e10-e47b-449a-b499-0c1b7ce8bd39 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:50.774964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 78/158] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:50 2022] GET /identity/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:50.779980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a42a-2505-4ccf-8fb9-7b696f70abcc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.780265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a42a-2505-4ccf-8fb9-7b696f70abcc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.780539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a42a-2505-4ccf-8fb9-7b696f70abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.810840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-89d5a42a-2505-4ccf-8fb9-7b696f70abcc None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:50.812521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-89d5a42a-2505-4ccf-8fb9-7b696f70abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:50.922568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17323-08b4-4438-99de-c9e52567bd74 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:50.956578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 79/159] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:50.957431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a42a-2505-4ccf-8fb9-7b696f70abcc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:50.994730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517594c-05d1-4aef-87da-d710133028e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:50.995491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517594c-05d1-4aef-87da-d710133028e9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.995775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517594c-05d1-4aef-87da-d710133028e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.996050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517594c-05d1-4aef-87da-d710133028e9 None admin] PATH_INFO: `/v3/users/dbdfd06d8c164b6bbee854095a9de4ae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.998116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517594c-05d1-4aef-87da-d710133028e9 None admin] RBAC: Authorizing `identity:get_user(user_id=dbdfd06d8c164b6bbee854095a9de4ae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:51.003114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517594c-05d1-4aef-87da-d710133028e9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:51.005373 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 81/160] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:50 2022] GET /identity/v3/users/dbdfd06d8c164b6bbee854095a9de4ae => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:51.006345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517594c-05d1-4aef-87da-d710133028e9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:51.019839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:51.155778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a42a-2505-4ccf-8fb9-7b696f70abcc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:51.169082 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:51.181270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517594c-05d1-4aef-87da-d710133028e9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:51.228939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1988a-eae9-4cc0-8803-273e73a4722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:51.230222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1988a-eae9-4cc0-8803-273e73a4722b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.230804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1988a-eae9-4cc0-8803-273e73a4722b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.231216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1988a-eae9-4cc0-8803-273e73a4722b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.231456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7122f75-ed2b-498c-8e86-69ec031a53a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:51.232175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7122f75-ed2b-498c-8e86-69ec031a53a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.232436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1988a-eae9-4cc0-8803-273e73a4722b None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=8ec546be13a842489477e0212c390b7d, user.id=839a76c19ea54ec68f0ff11e282ae859) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:51.232645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7122f75-ed2b-498c-8e86-69ec031a53a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.233029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7122f75-ed2b-498c-8e86-69ec031a53a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.233153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1988a-eae9-4cc0-8803-273e73a4722b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:51.234891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1988a-eae9-4cc0-8803-273e73a4722b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:51.241279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 80/161] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:50 2022] GET /identity/v3/role_assignments?user.id=839a76c19ea54ec68f0ff11e282ae859&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=946af2ff291349299db56e09aacb6b03 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:51.242277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1988a-eae9-4cc0-8803-273e73a4722b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:51.340634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7122f75-ed2b-498c-8e86-69ec031a53a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:51.342234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7122f75-ed2b-498c-8e86-69ec031a53a9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:51.352136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1988a-eae9-4cc0-8803-273e73a4722b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:51.353790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:51.389641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1677cbb-bca2-454b-927e-2e2a39ed64b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:51.390629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677cbb-bca2-454b-927e-2e2a39ed64b0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.391940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677cbb-bca2-454b-927e-2e2a39ed64b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.392428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677cbb-bca2-454b-927e-2e2a39ed64b0 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.393900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1677cbb-bca2-454b-927e-2e2a39ed64b0 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:51.395764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1677cbb-bca2-454b-927e-2e2a39ed64b0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:51.397617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 81/162] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:51 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:51.399165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c703d06-9caa-42b2-933a-ccf4e8a5cfec None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.399666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c703d06-9caa-42b2-933a-ccf4e8a5cfec None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.400107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c703d06-9caa-42b2-933a-ccf4e8a5cfec None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.401503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 82/163] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:51.403286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c703d06-9caa-42b2-933a-ccf4e8a5cfec None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:51.447669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:51.462714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 82/164] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:20:51.463594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc377884-472d-424d-a0e8-425e1e7a90bd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.463594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc377884-472d-424d-a0e8-425e1e7a90bd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.463788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc377884-472d-424d-a0e8-425e1e7a90bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.484226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dc377884-472d-424d-a0e8-425e1e7a90bd None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:51.485595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dc377884-472d-424d-a0e8-425e1e7a90bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:51.571909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c703d06-9caa-42b2-933a-ccf4e8a5cfec None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:51.596177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 83/165] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:51.596967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc377884-472d-424d-a0e8-425e1e7a90bd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:51.640197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3523133-972e-4f18-990d-276aac598397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:51.641509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3523133-972e-4f18-990d-276aac598397 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.641791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3523133-972e-4f18-990d-276aac598397 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.642104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3523133-972e-4f18-990d-276aac598397 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d/users/dbdfd06d8c164b6bbee854095a9de4ae/roles/749cda9c1c1448eeba2fa484424d0b15` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.646644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3523133-972e-4f18-990d-276aac598397 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ec546be13a842489477e0212c390b7d, user_id=dbdfd06d8c164b6bbee854095a9de4ae, role_id=749cda9c1c1448eeba2fa484424d0b15)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:51.650203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3523133-972e-4f18-990d-276aac598397 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:51.680295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 83/166] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:20:51 2022] PUT /identity/v3/projects/8ec546be13a842489477e0212c390b7d/users/dbdfd06d8c164b6bbee854095a9de4ae/roles/749cda9c1c1448eeba2fa484424d0b15 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:20:51.681213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3523133-972e-4f18-990d-276aac598397 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:51.721791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:51.785641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc377884-472d-424d-a0e8-425e1e7a90bd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:51.835054 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:51.856107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcd89e-8da4-437f-8a87-63911688b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:51.857065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd89e-8da4-437f-8a87-63911688b9ad None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.858417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd89e-8da4-437f-8a87-63911688b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.859911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd89e-8da4-437f-8a87-63911688b9ad None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.862791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3523133-972e-4f18-990d-276aac598397 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:51.864477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcd89e-8da4-437f-8a87-63911688b9ad None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:51.866189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcd89e-8da4-437f-8a87-63911688b9ad None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:51.869532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 84/167] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:51 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:51.876235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcd89e-8da4-437f-8a87-63911688b9ad None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:51.927751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500163bc-a0d8-42b2-a087-7d434f23ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:51.928829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500163bc-a0d8-42b2-a087-7d434f23ad64 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.929311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500163bc-a0d8-42b2-a087-7d434f23ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.929858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500163bc-a0d8-42b2-a087-7d434f23ad64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.944478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500163bc-a0d8-42b2-a087-7d434f23ad64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-500163bc-a0d8-42b2-a087-7d434f23ad64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:51.949886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:51.953886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:51.954779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:51.957449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 84/168] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:20:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:51.963090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500163bc-a0d8-42b2-a087-7d434f23ad64 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.043722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcd89e-8da4-437f-8a87-63911688b9ad None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.061970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:52.080975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500163bc-a0d8-42b2-a087-7d434f23ad64 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.095204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d6c21-5654-49ac-a5c5-b54cb89104d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.096083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d6c21-5654-49ac-a5c5-b54cb89104d3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.096364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d6c21-5654-49ac-a5c5-b54cb89104d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.096637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d6c21-5654-49ac-a5c5-b54cb89104d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.097377 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d6c21-5654-49ac-a5c5-b54cb89104d3 None admin] RBAC: Adding query filter params (role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=8ec546be13a842489477e0212c390b7d, user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:52.097687 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d6c21-5654-49ac-a5c5-b54cb89104d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:52.099444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d6c21-5654-49ac-a5c5-b54cb89104d3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:52.105424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 85/169] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:51 2022] GET /identity/v3/role_assignments?user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:52.123202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bc799-71b5-4ab5-b4bf-351697c64a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.124167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bc799-71b5-4ab5-b4bf-351697c64a75 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.124649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bc799-71b5-4ab5-b4bf-351697c64a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.125155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bc799-71b5-4ab5-b4bf-351697c64a75 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.126429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bc799-71b5-4ab5-b4bf-351697c64a75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:52.126957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bc799-71b5-4ab5-b4bf-351697c64a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:52.128567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bc799-71b5-4ab5-b4bf-351697c64a75 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:52.138516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 85/170] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:20:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:52.144684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d6c21-5654-49ac-a5c5-b54cb89104d3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.224602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bc799-71b5-4ab5-b4bf-351697c64a75 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.235305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:52.368087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d6c21-5654-49ac-a5c5-b54cb89104d3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.383901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bc799-71b5-4ab5-b4bf-351697c64a75 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.433385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39789bbf-6ef5-41dc-b570-25abc8c821a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.434430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39789bbf-6ef5-41dc-b570-25abc8c821a7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.434940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39789bbf-6ef5-41dc-b570-25abc8c821a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.435435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39789bbf-6ef5-41dc-b570-25abc8c821a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.453893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39789bbf-6ef5-41dc-b570-25abc8c821a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-39789bbf-6ef5-41dc-b570-25abc8c821a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:52.459835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:52.460814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:52.461628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:52.462224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e48abc-e346-4e29-ae17-2291fd844589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.462224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48abc-e346-4e29-ae17-2291fd844589 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.462224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48abc-e346-4e29-ae17-2291fd844589 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.462224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48abc-e346-4e29-ae17-2291fd844589 None admin] PATH_INFO: `/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.464326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 86/171] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:52.465192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e48abc-e346-4e29-ae17-2291fd844589 None admin] RBAC: Authorizing `identity:get_user(user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:52.466673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e48abc-e346-4e29-ae17-2291fd844589 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:52.468322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 86/172] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:52 2022] GET /identity/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:52.472621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39789bbf-6ef5-41dc-b570-25abc8c821a7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.474616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e48abc-e346-4e29-ae17-2291fd844589 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.483821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:52.617592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39789bbf-6ef5-41dc-b570-25abc8c821a7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.675835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d780c-2c60-4702-8838-248a5e973916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.676471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d780c-2c60-4702-8838-248a5e973916 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.676749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d780c-2c60-4702-8838-248a5e973916 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.677023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d780c-2c60-4702-8838-248a5e973916 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.677720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d780c-2c60-4702-8838-248a5e973916 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:52.678008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d780c-2c60-4702-8838-248a5e973916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:52.679499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d780c-2c60-4702-8838-248a5e973916 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:52.688404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 87/173] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:52.698812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d780c-2c60-4702-8838-248a5e973916 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.780721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:52.788731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e48abc-e346-4e29-ae17-2291fd844589 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.825036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d780c-2c60-4702-8838-248a5e973916 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.848041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:52.872540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ba402-6eb4-47d9-b630-491a6d6f0526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.873179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ba402-6eb4-47d9-b630-491a6d6f0526 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.873459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ba402-6eb4-47d9-b630-491a6d6f0526 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.873735 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ba402-6eb4-47d9-b630-491a6d6f0526 None admin] PATH_INFO: `/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.875516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ba402-6eb4-47d9-b630-491a6d6f0526 None admin] RBAC: Authorizing `identity:get_user(user_id=b91fb1c4eb2941b8b5dbc452aa5dd9c4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:52.877046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ba402-6eb4-47d9-b630-491a6d6f0526 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:52.878906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 88/174] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:52 2022] GET /identity/v3/users/b91fb1c4eb2941b8b5dbc452aa5dd9c4 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:52.884257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ba402-6eb4-47d9-b630-491a6d6f0526 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.884399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af294bd-1e25-4244-9912-b1efe0f9785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.884930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af294bd-1e25-4244-9912-b1efe0f9785e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.885221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af294bd-1e25-4244-9912-b1efe0f9785e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.885500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af294bd-1e25-4244-9912-b1efe0f9785e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.011798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af294bd-1e25-4244-9912-b1efe0f9785e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.013414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af294bd-1e25-4244-9912-b1efe0f9785e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.039946 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ba402-6eb4-47d9-b630-491a6d6f0526 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.075667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb93ff-58c1-4b8f-8e64-e2909398ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.076529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb93ff-58c1-4b8f-8e64-e2909398ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.076948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb93ff-58c1-4b8f-8e64-e2909398ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.077368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb93ff-58c1-4b8f-8e64-e2909398ffb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.081808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:53.121116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 87/175] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 11:20:53.123093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341d9d-16bc-49be-b1a1-b1182c17f927 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.123934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341d9d-16bc-49be-b1a1-b1182c17f927 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.124354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341d9d-16bc-49be-b1a1-b1182c17f927 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.126944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 88/176] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:53.128622 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492eace-3505-4993-8994-6c0a97b8bab2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.129299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492eace-3505-4993-8994-6c0a97b8bab2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.129725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492eace-3505-4993-8994-6c0a97b8bab2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.131350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 89/177] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:53.132890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4580f-14ce-4ee2-b54b-bbcbd07f58bb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.133326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4580f-14ce-4ee2-b54b-bbcbd07f58bb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.133737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4580f-14ce-4ee2-b54b-bbcbd07f58bb None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.135897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 90/178] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:53.136811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4580f-14ce-4ee2-b54b-bbcbd07f58bb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.155513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb93ff-58c1-4b8f-8e64-e2909398ffb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.157320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb93ff-58c1-4b8f-8e64-e2909398ffb7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.169732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:53.251981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4580f-14ce-4ee2-b54b-bbcbd07f58bb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.265900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 89/179] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:20:53.267489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65686610-e0e3-4ca3-9ee3-9493fa4112b1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.267954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65686610-e0e3-4ca3-9ee3-9493fa4112b1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.268360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65686610-e0e3-4ca3-9ee3-9493fa4112b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.286405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-65686610-e0e3-4ca3-9ee3-9493fa4112b1 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:53.287626 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-65686610-e0e3-4ca3-9ee3-9493fa4112b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:53.287853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd538d-fdda-4e52-be8c-08f80df126e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.288587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd538d-fdda-4e52-be8c-08f80df126e5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.288866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd538d-fdda-4e52-be8c-08f80df126e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.289165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd538d-fdda-4e52-be8c-08f80df126e5 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.290402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd538d-fdda-4e52-be8c-08f80df126e5 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.291905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd538d-fdda-4e52-be8c-08f80df126e5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.293694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 91/180] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:53.294627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bd844-eb99-4555-b6cb-d1d62d518791 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.294933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bd844-eb99-4555-b6cb-d1d62d518791 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.295207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bd844-eb99-4555-b6cb-d1d62d518791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.314310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-031bd844-eb99-4555-b6cb-d1d62d518791 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:53.315526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-031bd844-eb99-4555-b6cb-d1d62d518791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:53.324839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:53.365486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 90/181] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:53.367084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e844a00-b631-45e8-95e5-ddd459458676 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.367362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e844a00-b631-45e8-95e5-ddd459458676 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.367630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e844a00-b631-45e8-95e5-ddd459458676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.386446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7e844a00-b631-45e8-95e5-ddd459458676 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:53.387637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7e844a00-b631-45e8-95e5-ddd459458676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:53.404244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 92/182] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:53.405304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bd844-eb99-4555-b6cb-d1d62d518791 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.432821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:53.518854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bd844-eb99-4555-b6cb-d1d62d518791 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.556398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f318fd-c0a0-4ded-a836-50eeb37c0bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.557364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f318fd-c0a0-4ded-a836-50eeb37c0bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.557825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f318fd-c0a0-4ded-a836-50eeb37c0bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.558277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f318fd-c0a0-4ded-a836-50eeb37c0bd0 None admin] PATH_INFO: `/v3/projects/5d83d8ba422a45ac96b81f068dbe494b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.559710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f318fd-c0a0-4ded-a836-50eeb37c0bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=5d83d8ba422a45ac96b81f068dbe494b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.561432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f318fd-c0a0-4ded-a836-50eeb37c0bd0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.561548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 91/183] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:53.563058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e844a00-b631-45e8-95e5-ddd459458676 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.564960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 93/184] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/projects/5d83d8ba422a45ac96b81f068dbe494b => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:53.571195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f318fd-c0a0-4ded-a836-50eeb37c0bd0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.716989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:53.727203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e844a00-b631-45e8-95e5-ddd459458676 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.769954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df05d7-7cc4-48f8-a59c-58a6bf460372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.771021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df05d7-7cc4-48f8-a59c-58a6bf460372 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.771778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df05d7-7cc4-48f8-a59c-58a6bf460372 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.772250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df05d7-7cc4-48f8-a59c-58a6bf460372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.773161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df05d7-7cc4-48f8-a59c-58a6bf460372 None admin] RBAC: Adding query filter params (role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=8ec546be13a842489477e0212c390b7d, user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:53.773655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df05d7-7cc4-48f8-a59c-58a6bf460372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.776025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df05d7-7cc4-48f8-a59c-58a6bf460372 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.776893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:53.784762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 92/185] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/role_assignments?user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:53.785781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df05d7-7cc4-48f8-a59c-58a6bf460372 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.800635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f318fd-c0a0-4ded-a836-50eeb37c0bd0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.885720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb30dd-4ca5-49b0-87ff-6f1ca6fc0b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.886395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb30dd-4ca5-49b0-87ff-6f1ca6fc0b35 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.886677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb30dd-4ca5-49b0-87ff-6f1ca6fc0b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.886965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb30dd-4ca5-49b0-87ff-6f1ca6fc0b35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.887706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb30dd-4ca5-49b0-87ff-6f1ca6fc0b35 None admin] RBAC: Adding query filter params (role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=5d83d8ba422a45ac96b81f068dbe494b, user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:53.888010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb30dd-4ca5-49b0-87ff-6f1ca6fc0b35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.889466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb30dd-4ca5-49b0-87ff-6f1ca6fc0b35 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.908283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df05d7-7cc4-48f8-a59c-58a6bf460372 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.913097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 94/186] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/role_assignments?user.id=b91fb1c4eb2941b8b5dbc452aa5dd9c4&scope.project.id=5d83d8ba422a45ac96b81f068dbe494b&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:53.914146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb30dd-4ca5-49b0-87ff-6f1ca6fc0b35 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.957898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a0d8a-c5fa-4338-8dd3-9597d175da6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.959488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a0d8a-c5fa-4338-8dd3-9597d175da6d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.959989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a0d8a-c5fa-4338-8dd3-9597d175da6d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.960438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a0d8a-c5fa-4338-8dd3-9597d175da6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.977865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a0d8a-c5fa-4338-8dd3-9597d175da6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-b67a0d8a-c5fa-4338-8dd3-9597d175da6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:53.986928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:53.987936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:20:53.988714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 93/187] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:53.989382 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a0d8a-c5fa-4338-8dd3-9597d175da6d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.030269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.050425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb30dd-4ca5-49b0-87ff-6f1ca6fc0b35 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.090833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74469bc1-edd2-420f-ad2c-ae1fa8ca25a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.091482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74469bc1-edd2-420f-ad2c-ae1fa8ca25a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.091764 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74469bc1-edd2-420f-ad2c-ae1fa8ca25a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.092036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74469bc1-edd2-420f-ad2c-ae1fa8ca25a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.105561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74469bc1-edd2-420f-ad2c-ae1fa8ca25a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-74469bc1-edd2-420f-ad2c-ae1fa8ca25a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:54.111912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:54.112858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:54.113647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 95/188] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:54.119926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74469bc1-edd2-420f-ad2c-ae1fa8ca25a9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.136956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a0d8a-c5fa-4338-8dd3-9597d175da6d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.140292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.193936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303595cb-85d4-46b5-b184-04f3473a7dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.194898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303595cb-85d4-46b5-b184-04f3473a7dbe None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.195186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303595cb-85d4-46b5-b184-04f3473a7dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.195486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303595cb-85d4-46b5-b184-04f3473a7dbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.197291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303595cb-85d4-46b5-b184-04f3473a7dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.199324 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303595cb-85d4-46b5-b184-04f3473a7dbe None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.201556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 94/189] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:54.202162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303595cb-85d4-46b5-b184-04f3473a7dbe None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.260003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74469bc1-edd2-420f-ad2c-ae1fa8ca25a9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.302543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dc171-2f8f-421d-adce-e88ea448d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.303269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dc171-2f8f-421d-adce-e88ea448d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.303553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dc171-2f8f-421d-adce-e88ea448d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.303827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dc171-2f8f-421d-adce-e88ea448d4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.304500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dc171-2f8f-421d-adce-e88ea448d4e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:54.304801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dc171-2f8f-421d-adce-e88ea448d4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.306456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dc171-2f8f-421d-adce-e88ea448d4e5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.312006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.316790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 96/190] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:54.317596 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dc171-2f8f-421d-adce-e88ea448d4e5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.329836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303595cb-85d4-46b5-b184-04f3473a7dbe None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.369834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff5ab-9fba-4a23-a3e2-907fa6a0f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.370446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff5ab-9fba-4a23-a3e2-907fa6a0f952 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.370757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff5ab-9fba-4a23-a3e2-907fa6a0f952 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.371035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff5ab-9fba-4a23-a3e2-907fa6a0f952 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.371703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bff5ab-9fba-4a23-a3e2-907fa6a0f952 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:54.372006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bff5ab-9fba-4a23-a3e2-907fa6a0f952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.373416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bff5ab-9fba-4a23-a3e2-907fa6a0f952 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.381862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 95/191] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:20:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:54.382700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff5ab-9fba-4a23-a3e2-907fa6a0f952 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.405669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.430967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dc171-2f8f-421d-adce-e88ea448d4e5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.465590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c34bbe-21e6-4d13-8d87-8938f97c0798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.466560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c34bbe-21e6-4d13-8d87-8938f97c0798 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.467048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c34bbe-21e6-4d13-8d87-8938f97c0798 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.467509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c34bbe-21e6-4d13-8d87-8938f97c0798 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.468328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c34bbe-21e6-4d13-8d87-8938f97c0798 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.471488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c34bbe-21e6-4d13-8d87-8938f97c0798 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.490463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff5ab-9fba-4a23-a3e2-907fa6a0f952 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.495182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 97/192] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:20:54 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:54.496206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c34bbe-21e6-4d13-8d87-8938f97c0798 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.537747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dea48-9801-43c2-b3da-23fa6859fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.538403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dea48-9801-43c2-b3da-23fa6859fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.538706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dea48-9801-43c2-b3da-23fa6859fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.539063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dea48-9801-43c2-b3da-23fa6859fdf2 None admin] PATH_INFO: `/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.555480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dea48-9801-43c2-b3da-23fa6859fdf2 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ef8c04b4e44ff1b27c3782a4afb9a8)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.556926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dea48-9801-43c2-b3da-23fa6859fdf2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.558913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 96/193] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:54 2022] GET /identity/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:54.564758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dea48-9801-43c2-b3da-23fa6859fdf2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.576885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.631568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c34bbe-21e6-4d13-8d87-8938f97c0798 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.672933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.681077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675289a9-0b15-403e-8db6-7bfefda7b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.682429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675289a9-0b15-403e-8db6-7bfefda7b677 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.682760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675289a9-0b15-403e-8db6-7bfefda7b677 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.683041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675289a9-0b15-403e-8db6-7bfefda7b677 None admin] PATH_INFO: `/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.684237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dea48-9801-43c2-b3da-23fa6859fdf2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.684359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675289a9-0b15-403e-8db6-7bfefda7b677 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ef8c04b4e44ff1b27c3782a4afb9a8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.685716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675289a9-0b15-403e-8db6-7bfefda7b677 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.689770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 98/194] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:54 2022] GET /identity/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:54.689770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6ac80-f5f3-4cee-a940-b47b53aff958 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.689770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6ac80-f5f3-4cee-a940-b47b53aff958 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.689770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6ac80-f5f3-4cee-a940-b47b53aff958 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.693188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 99/195] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:54.693330 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6ac80-f5f3-4cee-a940-b47b53aff958 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.734419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3891871-e790-4426-8f8d-cd5bc0a6734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.735298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3891871-e790-4426-8f8d-cd5bc0a6734c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.735528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3891871-e790-4426-8f8d-cd5bc0a6734c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.735804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3891871-e790-4426-8f8d-cd5bc0a6734c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.819362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3891871-e790-4426-8f8d-cd5bc0a6734c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.820914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3891871-e790-4426-8f8d-cd5bc0a6734c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.825337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6ac80-f5f3-4cee-a940-b47b53aff958 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.832210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.870673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6008b1d-9786-4cb4-ac0a-93bcba0de3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.871304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6008b1d-9786-4cb4-ac0a-93bcba0de3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.871589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6008b1d-9786-4cb4-ac0a-93bcba0de3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.871862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6008b1d-9786-4cb4-ac0a-93bcba0de3f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.938347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 97/196] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 11:20:54.939928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa938-44bf-4535-8d17-352389cbdc4a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.940214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa938-44bf-4535-8d17-352389cbdc4a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.940486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa938-44bf-4535-8d17-352389cbdc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.956261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.959726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6008b1d-9786-4cb4-ac0a-93bcba0de3f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.961455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6008b1d-9786-4cb4-ac0a-93bcba0de3f4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.962669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-409fa938-44bf-4535-8d17-352389cbdc4a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:54.964914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-409fa938-44bf-4535-8d17-352389cbdc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:55.046860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 98/197] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:55.056036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa938-44bf-4535-8d17-352389cbdc4a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.093267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 100/198] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 11:20:55.098952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6008b1d-9786-4cb4-ac0a-93bcba0de3f4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.125452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:55.221597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa938-44bf-4535-8d17-352389cbdc4a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.259029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c0ab-2612-46fb-8b22-9b3f7740e51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.259953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c0ab-2612-46fb-8b22-9b3f7740e51e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.260231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c0ab-2612-46fb-8b22-9b3f7740e51e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.260504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c0ab-2612-46fb-8b22-9b3f7740e51e None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.261636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c0ab-2612-46fb-8b22-9b3f7740e51e None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.263569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c0ab-2612-46fb-8b22-9b3f7740e51e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.265221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 99/199] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:55.271210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c0ab-2612-46fb-8b22-9b3f7740e51e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.295775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6008b1d-9786-4cb4-ac0a-93bcba0de3f4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.298510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:55.369244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bf614-137a-4e20-b73f-bc181a3f326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.369796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bf614-137a-4e20-b73f-bc181a3f326d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.370067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bf614-137a-4e20-b73f-bc181a3f326d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.370335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bf614-137a-4e20-b73f-bc181a3f326d None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.374431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bf614-137a-4e20-b73f-bc181a3f326d None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.377767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bf614-137a-4e20-b73f-bc181a3f326d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.379679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 101/200] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:55.399468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bf614-137a-4e20-b73f-bc181a3f326d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.441877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c0ab-2612-46fb-8b22-9b3f7740e51e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.451129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:55.485961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f39be-d89e-4d95-9680-039146e2e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.486727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f39be-d89e-4d95-9680-039146e2e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.487060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f39be-d89e-4d95-9680-039146e2e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.487332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f39be-d89e-4d95-9680-039146e2e9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.488052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f39be-d89e-4d95-9680-039146e2e9f4 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c, user.id=a4ef8c04b4e44ff1b27c3782a4afb9a8) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:55.488694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f39be-d89e-4d95-9680-039146e2e9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.490427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f39be-d89e-4d95-9680-039146e2e9f4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.496907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 100/201] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/role_assignments?user.id=a4ef8c04b4e44ff1b27c3782a4afb9a8&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=946af2ff291349299db56e09aacb6b03 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:55.497679 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f39be-d89e-4d95-9680-039146e2e9f4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.524865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bf614-137a-4e20-b73f-bc181a3f326d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.598872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbbae1-eed4-495c-870e-abb85d8824fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.599954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbbae1-eed4-495c-870e-abb85d8824fa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.601219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbbae1-eed4-495c-870e-abb85d8824fa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.601848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbbae1-eed4-495c-870e-abb85d8824fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.626817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbbae1-eed4-495c-870e-abb85d8824fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-05dbbae1-eed4-495c-870e-abb85d8824fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:55.632657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:55.633581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:20:55.634345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:55.636974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 102/202] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:20:55.646091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbbae1-eed4-495c-870e-abb85d8824fa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.699073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:55.708067 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f39be-d89e-4d95-9680-039146e2e9f4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.744697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5858f0c-086f-4bc9-9d78-77aaaae3283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.745314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5858f0c-086f-4bc9-9d78-77aaaae3283a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.745590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5858f0c-086f-4bc9-9d78-77aaaae3283a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.745857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5858f0c-086f-4bc9-9d78-77aaaae3283a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.746962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5858f0c-086f-4bc9-9d78-77aaaae3283a None admin] RBAC: Adding query filter params (role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c, user.id=a4ef8c04b4e44ff1b27c3782a4afb9a8) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:55.746962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5858f0c-086f-4bc9-9d78-77aaaae3283a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.748346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5858f0c-086f-4bc9-9d78-77aaaae3283a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.766730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 101/203] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/role_assignments?user.id=a4ef8c04b4e44ff1b27c3782a4afb9a8&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:55.808643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbbae1-eed4-495c-870e-abb85d8824fa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.873046 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0da90-2aa1-427e-8698-77f4a0255166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.873675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0da90-2aa1-427e-8698-77f4a0255166 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.873953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0da90-2aa1-427e-8698-77f4a0255166 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.874224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0da90-2aa1-427e-8698-77f4a0255166 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.875053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0da90-2aa1-427e-8698-77f4a0255166 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:55.875421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0da90-2aa1-427e-8698-77f4a0255166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.876905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0da90-2aa1-427e-8698-77f4a0255166 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.891541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 103/204] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:55.897432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5858f0c-086f-4bc9-9d78-77aaaae3283a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.945677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:56.027143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5858f0c-086f-4bc9-9d78-77aaaae3283a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:56.064057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1ffe-f63d-4479-99e7-5e3f83fe9636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:56.065048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1ffe-f63d-4479-99e7-5e3f83fe9636 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.065546 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1ffe-f63d-4479-99e7-5e3f83fe9636 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.066055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1ffe-f63d-4479-99e7-5e3f83fe9636 None admin] PATH_INFO: `/v3/users/dbdfd06d8c164b6bbee854095a9de4ae` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.067407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1ffe-f63d-4479-99e7-5e3f83fe9636 None admin] RBAC: Authorizing `identity:get_user(user_id=dbdfd06d8c164b6bbee854095a9de4ae)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:56.069093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1ffe-f63d-4479-99e7-5e3f83fe9636 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:56.074722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 102/205] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/users/dbdfd06d8c164b6bbee854095a9de4ae => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:56.079826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0da90-2aa1-427e-8698-77f4a0255166 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:56.208524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:56.217954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0da90-2aa1-427e-8698-77f4a0255166 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:56.267388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b7ab0-bc03-4031-85fa-01ebce133137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:56.268066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b7ab0-bc03-4031-85fa-01ebce133137 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.268349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b7ab0-bc03-4031-85fa-01ebce133137 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.268612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b7ab0-bc03-4031-85fa-01ebce133137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.362516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b7ab0-bc03-4031-85fa-01ebce133137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:56.364024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b7ab0-bc03-4031-85fa-01ebce133137 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:56.479641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:56.495360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 104/206] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:20:56.501657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1ffe-f63d-4479-99e7-5e3f83fe9636 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:56.611409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1ffe-f63d-4479-99e7-5e3f83fe9636 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:56.623191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:56.648214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412f829-463a-4b74-83cb-98967487c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:56.648879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412f829-463a-4b74-83cb-98967487c226 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.649159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412f829-463a-4b74-83cb-98967487c226 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.649431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412f829-463a-4b74-83cb-98967487c226 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.650553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412f829-463a-4b74-83cb-98967487c226 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:56.652900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8854-dc3b-4f6f-a8b7-653d2052c193 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.653178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8854-dc3b-4f6f-a8b7-653d2052c193 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.653445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8854-dc3b-4f6f-a8b7-653d2052c193 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.654931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 105/207] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:20:56.655581 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412f829-463a-4b74-83cb-98967487c226 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:56.657855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 103/208] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:56 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:56.663953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7b62f-f3f8-4d7a-90b0-f37e2e892bc7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.664275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7b62f-f3f8-4d7a-90b0-f37e2e892bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.664559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7b62f-f3f8-4d7a-90b0-f37e2e892bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.668707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412f829-463a-4b74-83cb-98967487c226 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:56.686405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-47d7b62f-f3f8-4d7a-90b0-f37e2e892bc7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:56.688281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47d7b62f-f3f8-4d7a-90b0-f37e2e892bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:56.764331 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 106/209] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:20:56.840309 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412f829-463a-4b74-83cb-98967487c226 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:56.877119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e6d16-bc2e-4e50-b774-43d63b9af99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:56.877725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6d16-bc2e-4e50-b774-43d63b9af99f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.878002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6d16-bc2e-4e50-b774-43d63b9af99f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.878269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6d16-bc2e-4e50-b774-43d63b9af99f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.879024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e6d16-bc2e-4e50-b774-43d63b9af99f None admin] RBAC: Adding query filter params (role.id=749cda9c1c1448eeba2fa484424d0b15, scope.project.id=8ec546be13a842489477e0212c390b7d, user.id=dbdfd06d8c164b6bbee854095a9de4ae) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:56.879326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e6d16-bc2e-4e50-b774-43d63b9af99f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:56.880753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e6d16-bc2e-4e50-b774-43d63b9af99f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:56.886608 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 104/210] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:56 2022] GET /identity/v3/role_assignments?user.id=dbdfd06d8c164b6bbee854095a9de4ae&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=749cda9c1c1448eeba2fa484424d0b15 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:57.019918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998faa7d-9cf7-443f-892a-f9ec3f622cf0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.020109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998faa7d-9cf7-443f-892a-f9ec3f622cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.020382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998faa7d-9cf7-443f-892a-f9ec3f622cf0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.021762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 107/211] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:57.034132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79565-eb25-41ff-8368-dfbac9e0e53d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.034440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79565-eb25-41ff-8368-dfbac9e0e53d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.034713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79565-eb25-41ff-8368-dfbac9e0e53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.055601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f6b79565-eb25-41ff-8368-dfbac9e0e53d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:57.056824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f6b79565-eb25-41ff-8368-dfbac9e0e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:57.089891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:57.139587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998faa7d-9cf7-443f-892a-f9ec3f622cf0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:57.140959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 105/212] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:57.262751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998faa7d-9cf7-443f-892a-f9ec3f622cf0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:57.291172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:57.310608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86b731-85a7-4c32-bcb0-4f14690f64e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:57.311283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b731-85a7-4c32-bcb0-4f14690f64e6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.311559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b731-85a7-4c32-bcb0-4f14690f64e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.311824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b731-85a7-4c32-bcb0-4f14690f64e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.323749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86b731-85a7-4c32-bcb0-4f14690f64e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6d86b731-85a7-4c32-bcb0-4f14690f64e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:57.329550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:57.330415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:57.331256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 108/213] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:57.339782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79565-eb25-41ff-8368-dfbac9e0e53d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:57.432571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86b731-85a7-4c32-bcb0-4f14690f64e6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:57.461272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79565-eb25-41ff-8368-dfbac9e0e53d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:57.504936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee2ff7-ce68-4f75-856f-b770ca0b8dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:57.505585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee2ff7-ce68-4f75-856f-b770ca0b8dfd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.505851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee2ff7-ce68-4f75-856f-b770ca0b8dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.506698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee2ff7-ce68-4f75-856f-b770ca0b8dfd None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.507380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee2ff7-ce68-4f75-856f-b770ca0b8dfd None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:57.507955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee2ff7-ce68-4f75-856f-b770ca0b8dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:57.509622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee2ff7-ce68-4f75-856f-b770ca0b8dfd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:57.523248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 106/214] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:20:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:57.529152 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee2ff7-ce68-4f75-856f-b770ca0b8dfd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:57.547676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86b731-85a7-4c32-bcb0-4f14690f64e6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:57.564099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:57.596161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add265-7be7-4f31-bf27-21dab04ba531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:57.597578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add265-7be7-4f31-bf27-21dab04ba531 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.598032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add265-7be7-4f31-bf27-21dab04ba531 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.598448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add265-7be7-4f31-bf27-21dab04ba531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.600328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0add265-7be7-4f31-bf27-21dab04ba531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:57.602631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0add265-7be7-4f31-bf27-21dab04ba531 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:57.605635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 109/215] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:20:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:57.611222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add265-7be7-4f31-bf27-21dab04ba531 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:57.652393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee2ff7-ce68-4f75-856f-b770ca0b8dfd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:57.668770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:57.700677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9a2b4-73fa-456a-ad5b-6ab2f58df05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:57.701315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9a2b4-73fa-456a-ad5b-6ab2f58df05a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.701639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9a2b4-73fa-456a-ad5b-6ab2f58df05a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.701915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9a2b4-73fa-456a-ad5b-6ab2f58df05a None admin] PATH_INFO: `/v3/users/3e930d2239aa4cdc9065c92d513a9267` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.716196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9a2b4-73fa-456a-ad5b-6ab2f58df05a None admin] RBAC: Authorizing `identity:get_user(user_id=3e930d2239aa4cdc9065c92d513a9267)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:57.717667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9a2b4-73fa-456a-ad5b-6ab2f58df05a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:57.719728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 107/216] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:57 2022] GET /identity/v3/users/3e930d2239aa4cdc9065c92d513a9267 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:57.728071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9a2b4-73fa-456a-ad5b-6ab2f58df05a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:57.736784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add265-7be7-4f31-bf27-21dab04ba531 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:57.772611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55fec-9797-48dd-8f2b-62d41a490885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:57.773471 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55fec-9797-48dd-8f2b-62d41a490885 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.773888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55fec-9797-48dd-8f2b-62d41a490885 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.774334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55fec-9797-48dd-8f2b-62d41a490885 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.775201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55fec-9797-48dd-8f2b-62d41a490885 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:57.776820 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55fec-9797-48dd-8f2b-62d41a490885 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:57.811065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 110/217] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:20:57 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:57.835805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:57.856821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9a2b4-73fa-456a-ad5b-6ab2f58df05a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:57.897070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23133e2-92cf-4673-8096-e01432e14ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:57.897779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23133e2-92cf-4673-8096-e01432e14ddb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.898063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23133e2-92cf-4673-8096-e01432e14ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.898338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23133e2-92cf-4673-8096-e01432e14ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.980824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23133e2-92cf-4673-8096-e01432e14ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:57.982291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23133e2-92cf-4673-8096-e01432e14ddb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:57.982670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598e848-75e8-4815-b03e-81074921eb3b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.982991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598e848-75e8-4815-b03e-81074921eb3b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.983270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598e848-75e8-4815-b03e-81074921eb3b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.984869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 111/218] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:57.989866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec38d6-13a1-41eb-86c5-270d823754cb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.990132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec38d6-13a1-41eb-86c5-270d823754cb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.990399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec38d6-13a1-41eb-86c5-270d823754cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.016849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-79ec38d6-13a1-41eb-86c5-270d823754cb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:58.018306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-79ec38d6-13a1-41eb-86c5-270d823754cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:58.083815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:58.104178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 108/219] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:20:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 11:20:58.110019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23133e2-92cf-4673-8096-e01432e14ddb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.112953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 112/220] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:58.204021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086fa2f-4035-4dd5-9b4a-417b7aca8158 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.204639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086fa2f-4035-4dd5-9b4a-417b7aca8158 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.206850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086fa2f-4035-4dd5-9b4a-417b7aca8158 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.208210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 113/221] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:20:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:20:58.214169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d99035-bca4-4abf-90ae-f82e79d0a782 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.214456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d99035-bca4-4abf-90ae-f82e79d0a782 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.214815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d99035-bca4-4abf-90ae-f82e79d0a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.230095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23133e2-92cf-4673-8096-e01432e14ddb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:58.240395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-38d99035-bca4-4abf-90ae-f82e79d0a782 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:58.241956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-38d99035-bca4-4abf-90ae-f82e79d0a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:58.267508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ebd79-f2b9-4c32-9e68-333c63bea947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:58.268142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ebd79-f2b9-4c32-9e68-333c63bea947 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.268463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ebd79-f2b9-4c32-9e68-333c63bea947 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.268745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ebd79-f2b9-4c32-9e68-333c63bea947 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.269894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ebd79-f2b9-4c32-9e68-333c63bea947 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:58.271390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ebd79-f2b9-4c32-9e68-333c63bea947 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:58.273172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 109/222] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:58 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:58.277509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:58.279538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ebd79-f2b9-4c32-9e68-333c63bea947 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.333544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 114/223] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:20:58.344851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:58.398250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ebd79-f2b9-4c32-9e68-333c63bea947 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:58.433847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14604121-e234-48c2-bdc3-bc30882755ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:58.434457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604121-e234-48c2-bdc3-bc30882755ed None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.434807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604121-e234-48c2-bdc3-bc30882755ed None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.435084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604121-e234-48c2-bdc3-bc30882755ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.435820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14604121-e234-48c2-bdc3-bc30882755ed None admin] RBAC: Adding query filter params (role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c, user.id=3e930d2239aa4cdc9065c92d513a9267) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:58.436123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14604121-e234-48c2-bdc3-bc30882755ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:58.438247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14604121-e234-48c2-bdc3-bc30882755ed None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:58.444238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 110/224] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:20:58 2022] GET /identity/v3/role_assignments?user.id=3e930d2239aa4cdc9065c92d513a9267&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:58.461481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d99035-bca4-4abf-90ae-f82e79d0a782 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.578594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d99035-bca4-4abf-90ae-f82e79d0a782 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:58.617651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c906420-080a-4b53-bcdd-e87e18b0409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:58.618219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c906420-080a-4b53-bcdd-e87e18b0409d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.618503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c906420-080a-4b53-bcdd-e87e18b0409d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.618820 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c906420-080a-4b53-bcdd-e87e18b0409d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.630401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c906420-080a-4b53-bcdd-e87e18b0409d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2c906420-080a-4b53-bcdd-e87e18b0409d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:58.635408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:58.636284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:58.637087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 115/225] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:58.643540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14604121-e234-48c2-bdc3-bc30882755ed None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.743812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c906420-080a-4b53-bcdd-e87e18b0409d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.776959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14604121-e234-48c2-bdc3-bc30882755ed None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:58.786402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:58.797624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:58.851779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfaa8b-18cd-49ed-aa7f-b8ac5cedf10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:58.852395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfaa8b-18cd-49ed-aa7f-b8ac5cedf10a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.852677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfaa8b-18cd-49ed-aa7f-b8ac5cedf10a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.852945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfaa8b-18cd-49ed-aa7f-b8ac5cedf10a None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.853620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfaa8b-18cd-49ed-aa7f-b8ac5cedf10a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:58.853919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfaa8b-18cd-49ed-aa7f-b8ac5cedf10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:58.855337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfaa8b-18cd-49ed-aa7f-b8ac5cedf10a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:58.865138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 111/226] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:58.871830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfaa8b-18cd-49ed-aa7f-b8ac5cedf10a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.888485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c906420-080a-4b53-bcdd-e87e18b0409d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:58.955874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ce253-6ddc-4e72-b605-a57197d65ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:58.956850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ce253-6ddc-4e72-b605-a57197d65ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.957471 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ce253-6ddc-4e72-b605-a57197d65ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.958174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ce253-6ddc-4e72-b605-a57197d65ff5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.975810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ce253-6ddc-4e72-b605-a57197d65ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-930ce253-6ddc-4e72-b605-a57197d65ff5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:20:58.980600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:20:58.981480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:20:58.982261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:20:58.986789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 116/227] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:20:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:20:58.988335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ce253-6ddc-4e72-b605-a57197d65ff5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.074816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfaa8b-18cd-49ed-aa7f-b8ac5cedf10a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.145028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce41ee7-17bd-4787-a461-d4ddcffe43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.145999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce41ee7-17bd-4787-a461-d4ddcffe43ff None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.146475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce41ee7-17bd-4787-a461-d4ddcffe43ff None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.146994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce41ee7-17bd-4787-a461-d4ddcffe43ff None admin] PATH_INFO: `/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.149144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce41ee7-17bd-4787-a461-d4ddcffe43ff None admin] RBAC: Authorizing `identity:get_user(user_id=a4ef8c04b4e44ff1b27c3782a4afb9a8)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.150830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce41ee7-17bd-4787-a461-d4ddcffe43ff None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.154107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 112/228] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:58 2022] GET /identity/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:59.159830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce41ee7-17bd-4787-a461-d4ddcffe43ff None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.164862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:59.184287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ce253-6ddc-4e72-b605-a57197d65ff5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.229238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4a95c-7855-4888-9a3f-1e3ad4164407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.230193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a95c-7855-4888-9a3f-1e3ad4164407 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.230713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a95c-7855-4888-9a3f-1e3ad4164407 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.231211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a95c-7855-4888-9a3f-1e3ad4164407 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.232081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4a95c-7855-4888-9a3f-1e3ad4164407 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:59.232589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4a95c-7855-4888-9a3f-1e3ad4164407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.234839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4a95c-7855-4888-9a3f-1e3ad4164407 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.244085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 117/229] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:20:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:59.255813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4a95c-7855-4888-9a3f-1e3ad4164407 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.272190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:59.363321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce41ee7-17bd-4787-a461-d4ddcffe43ff None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.405409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9630b7-29d4-4c24-818f-ab6a626ae921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.406391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9630b7-29d4-4c24-818f-ab6a626ae921 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.406391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9630b7-29d4-4c24-818f-ab6a626ae921 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.406573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9630b7-29d4-4c24-818f-ab6a626ae921 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.409572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9630b7-29d4-4c24-818f-ab6a626ae921 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.411051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9630b7-29d4-4c24-818f-ab6a626ae921 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.412717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 113/230] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:59 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:59.422438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9630b7-29d4-4c24-818f-ab6a626ae921 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.454114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4a95c-7855-4888-9a3f-1e3ad4164407 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.520332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c4915-f343-49ef-a481-167e3383bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.520963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4915-f343-49ef-a481-167e3383bb78 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.521219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4915-f343-49ef-a481-167e3383bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.521490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4915-f343-49ef-a481-167e3383bb78 None admin] PATH_INFO: `/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.523525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c4915-f343-49ef-a481-167e3383bb78 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ef8c04b4e44ff1b27c3782a4afb9a8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.524983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c4915-f343-49ef-a481-167e3383bb78 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.526574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 118/231] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:20:59 2022] GET /identity/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:59.532337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c4915-f343-49ef-a481-167e3383bb78 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.562124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:59.612190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9630b7-29d4-4c24-818f-ab6a626ae921 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.633304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:59.675352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c010a-fb6d-4897-a5f9-34dea94b1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.676876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c010a-fb6d-4897-a5f9-34dea94b1bda None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.677352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c010a-fb6d-4897-a5f9-34dea94b1bda None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.677838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c010a-fb6d-4897-a5f9-34dea94b1bda None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/users/a4ef8c04b4e44ff1b27c3782a4afb9a8/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.680268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c010a-fb6d-4897-a5f9-34dea94b1bda None admin] RBAC: Authorizing `identity:create_grant(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c, user_id=a4ef8c04b4e44ff1b27c3782a4afb9a8, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.682042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c010a-fb6d-4897-a5f9-34dea94b1bda None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.700590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c4915-f343-49ef-a481-167e3383bb78 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.711931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 114/232] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:20:59 2022] PUT /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/users/a4ef8c04b4e44ff1b27c3782a4afb9a8/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:59.762325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66541a14-a10b-4f4f-96d8-e30dfa5443d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.763356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541a14-a10b-4f4f-96d8-e30dfa5443d8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.763839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541a14-a10b-4f4f-96d8-e30dfa5443d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.764310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541a14-a10b-4f4f-96d8-e30dfa5443d8 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.765879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66541a14-a10b-4f4f-96d8-e30dfa5443d8 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.767690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66541a14-a10b-4f4f-96d8-e30dfa5443d8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.769617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 119/233] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:20:59 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:59.775556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c010a-fb6d-4897-a5f9-34dea94b1bda None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.906805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c010a-fb6d-4897-a5f9-34dea94b1bda None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.955996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5f00c-44ba-4187-8d5c-a54681e34235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.957000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f00c-44ba-4187-8d5c-a54681e34235 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.957477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f00c-44ba-4187-8d5c-a54681e34235 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.957948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f00c-44ba-4187-8d5c-a54681e34235 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/users/a4ef8c04b4e44ff1b27c3782a4afb9a8/roles/d48e46bf2b814100a25f94d5cdffecfd` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.960405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5f00c-44ba-4187-8d5c-a54681e34235 None admin] RBAC: Authorizing `identity:create_grant(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c, user_id=a4ef8c04b4e44ff1b27c3782a4afb9a8, role_id=d48e46bf2b814100a25f94d5cdffecfd)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.962089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5f00c-44ba-4187-8d5c-a54681e34235 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.980273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 115/234] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:20:59 2022] PUT /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/users/a4ef8c04b4e44ff1b27c3782a4afb9a8/roles/d48e46bf2b814100a25f94d5cdffecfd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:00.285149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb045-0d31-4b1d-8b47-f06cd374fb68 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.285527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb045-0d31-4b1d-8b47-f06cd374fb68 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.285705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb045-0d31-4b1d-8b47-f06cd374fb68 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:00.287311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 120/235] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:00.294720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13fec-1ae5-4c93-af93-a9c3230a4583 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.294720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13fec-1ae5-4c93-af93-a9c3230a4583 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.294720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13fec-1ae5-4c93-af93-a9c3230a4583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:00.323733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-28f13fec-1ae5-4c93-af93-a9c3230a4583 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:00.325377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-28f13fec-1ae5-4c93-af93-a9c3230a4583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:00.366577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:00.424980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 116/236] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:00.552213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddefe1-8ea3-421c-a86d-e24b881c067a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.552709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddefe1-8ea3-421c-a86d-e24b881c067a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.552709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddefe1-8ea3-421c-a86d-e24b881c067a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:00.554003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 121/237] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:00.559333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8779b-a8ff-41c2-83ca-dd5b519959c5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.559612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8779b-a8ff-41c2-83ca-dd5b519959c5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.559882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8779b-a8ff-41c2-83ca-dd5b519959c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:00.578377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-99d8779b-a8ff-41c2-83ca-dd5b519959c5 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:00.579594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-99d8779b-a8ff-41c2-83ca-dd5b519959c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:00.676950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 117/238] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:00.703659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab031a-ae57-4986-aaa7-0acfab4cc97a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.704016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab031a-ae57-4986-aaa7-0acfab4cc97a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.704207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab031a-ae57-4986-aaa7-0acfab4cc97a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:00.705550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 122/239] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:00.722030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62db91-fe2e-4eaf-bcd6-7d17e4406e72 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.722311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62db91-fe2e-4eaf-bcd6-7d17e4406e72 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.722581 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62db91-fe2e-4eaf-bcd6-7d17e4406e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:00.751068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7c62db91-fe2e-4eaf-bcd6-7d17e4406e72 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:00.752248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7c62db91-fe2e-4eaf-bcd6-7d17e4406e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:00.785932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab031a-ae57-4986-aaa7-0acfab4cc97a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:00.866050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 118/240] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:00.910428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:00.938719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab031a-ae57-4986-aaa7-0acfab4cc97a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:00.959496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62db91-fe2e-4eaf-bcd6-7d17e4406e72 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:00.995988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c641c1-2e2f-4b80-b2a8-a782be4c9b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:00.996691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c641c1-2e2f-4b80-b2a8-a782be4c9b12 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.997151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c641c1-2e2f-4b80-b2a8-a782be4c9b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.997494 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c641c1-2e2f-4b80-b2a8-a782be4c9b12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.017222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:01.021487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c641c1-2e2f-4b80-b2a8-a782be4c9b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-92c641c1-2e2f-4b80-b2a8-a782be4c9b12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:01.026663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:01.027562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:01.028342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:01.028977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 123/241] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:01.036064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c641c1-2e2f-4b80-b2a8-a782be4c9b12 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:01.128642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62db91-fe2e-4eaf-bcd6-7d17e4406e72 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:01.174348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df6da2-f1da-40ca-b86a-5956c12b6372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:01.176705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df6da2-f1da-40ca-b86a-5956c12b6372 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.176986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df6da2-f1da-40ca-b86a-5956c12b6372 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.177259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df6da2-f1da-40ca-b86a-5956c12b6372 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.180034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df6da2-f1da-40ca-b86a-5956c12b6372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:01.181486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df6da2-f1da-40ca-b86a-5956c12b6372 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:01.185632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 119/242] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:01.190518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df6da2-f1da-40ca-b86a-5956c12b6372 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:01.216722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c641c1-2e2f-4b80-b2a8-a782be4c9b12 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:01.268773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6520-a5b0-42bc-9881-758d1d38d32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:01.269389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6520-a5b0-42bc-9881-758d1d38d32b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.269670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6520-a5b0-42bc-9881-758d1d38d32b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.269942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6520-a5b0-42bc-9881-758d1d38d32b None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.270615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6520-a5b0-42bc-9881-758d1d38d32b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:01.270943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6520-a5b0-42bc-9881-758d1d38d32b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:01.272339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6520-a5b0-42bc-9881-758d1d38d32b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:01.282563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 124/243] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:01.283474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6520-a5b0-42bc-9881-758d1d38d32b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:01.292415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:01.320746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:01.333027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df6da2-f1da-40ca-b86a-5956c12b6372 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:01.378758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b15d9-50a6-4bc8-99aa-619dc3e35895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:01.379747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b15d9-50a6-4bc8-99aa-619dc3e35895 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.380516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b15d9-50a6-4bc8-99aa-619dc3e35895 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.381283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b15d9-50a6-4bc8-99aa-619dc3e35895 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.382134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b15d9-50a6-4bc8-99aa-619dc3e35895 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:01.384345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b15d9-50a6-4bc8-99aa-619dc3e35895 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:01.403627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6520-a5b0-42bc-9881-758d1d38d32b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:01.410965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 120/244] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:21:01 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:01.412138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b15d9-50a6-4bc8-99aa-619dc3e35895 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:01.475765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364e2e-1b10-4190-aa8c-d0982ecae5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:01.476548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364e2e-1b10-4190-aa8c-d0982ecae5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.476832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364e2e-1b10-4190-aa8c-d0982ecae5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.477113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364e2e-1b10-4190-aa8c-d0982ecae5a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.503914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364e2e-1b10-4190-aa8c-d0982ecae5a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a1364e2e-1b10-4190-aa8c-d0982ecae5a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:01.509929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:01.510874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:01.511659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 125/245] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:01.519929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364e2e-1b10-4190-aa8c-d0982ecae5a5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:01.539933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b15d9-50a6-4bc8-99aa-619dc3e35895 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:01.580970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e7655-5c01-4d9c-8ef6-e54f3dd5ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:01.581996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e7655-5c01-4d9c-8ef6-e54f3dd5ad38 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.582475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e7655-5c01-4d9c-8ef6-e54f3dd5ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.583135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e7655-5c01-4d9c-8ef6-e54f3dd5ad38 None admin] PATH_INFO: `/v3/users/f7e96f01a378461780a9a06a0d968a6d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.600793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e7655-5c01-4d9c-8ef6-e54f3dd5ad38 None admin] RBAC: Authorizing `identity:get_user(user_id=f7e96f01a378461780a9a06a0d968a6d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:01.602635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e7655-5c01-4d9c-8ef6-e54f3dd5ad38 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:01.605174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 121/246] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:01 2022] GET /identity/v3/users/f7e96f01a378461780a9a06a0d968a6d => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:01.612105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e7655-5c01-4d9c-8ef6-e54f3dd5ad38 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:01.626930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:01.703365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:01.753939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e7655-5c01-4d9c-8ef6-e54f3dd5ad38 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:01.754776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364e2e-1b10-4190-aa8c-d0982ecae5a5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:01.799483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48b780-d82a-4a6b-b628-648b0dfafca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:01.800556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48b780-d82a-4a6b-b628-648b0dfafca0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.801423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48b780-d82a-4a6b-b628-648b0dfafca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.802163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f6c95-005c-42af-a120-035a503a22e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:01.802921 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f6c95-005c-42af-a120-035a503a22e5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.803168 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48b780-d82a-4a6b-b628-648b0dfafca0 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.803381 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f6c95-005c-42af-a120-035a503a22e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.803746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f6c95-005c-42af-a120-035a503a22e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.804401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48b780-d82a-4a6b-b628-648b0dfafca0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:01.804855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48b780-d82a-4a6b-b628-648b0dfafca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:01.806473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48b780-d82a-4a6b-b628-648b0dfafca0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:01.820813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 126/247] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:01.826638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48b780-d82a-4a6b-b628-648b0dfafca0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:01.890410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f6c95-005c-42af-a120-035a503a22e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:01.892475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f6c95-005c-42af-a120-035a503a22e5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:01.902506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:01.998183 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48b780-d82a-4a6b-b628-648b0dfafca0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:02.013918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 122/248] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:02.020380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f6c95-005c-42af-a120-035a503a22e5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:02.031102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:02.040318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103274-ff8b-477b-af3e-c20275a5acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:02.041104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103274-ff8b-477b-af3e-c20275a5acb8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.041482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103274-ff8b-477b-af3e-c20275a5acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.041870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103274-ff8b-477b-af3e-c20275a5acb8 None admin] PATH_INFO: `/v3/users/3e930d2239aa4cdc9065c92d513a9267` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.043158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7103274-ff8b-477b-af3e-c20275a5acb8 None admin] RBAC: Authorizing `identity:get_user(user_id=3e930d2239aa4cdc9065c92d513a9267)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:02.044755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7103274-ff8b-477b-af3e-c20275a5acb8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:02.046459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 127/249] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:01 2022] GET /identity/v3/users/3e930d2239aa4cdc9065c92d513a9267 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:02.052224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103274-ff8b-477b-af3e-c20275a5acb8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:02.135384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f6c95-005c-42af-a120-035a503a22e5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:02.145921 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:02.163651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103274-ff8b-477b-af3e-c20275a5acb8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:02.176462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309379c-fc54-4b12-b3a9-60492a18d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:02.177210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309379c-fc54-4b12-b3a9-60492a18d757 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.177560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309379c-fc54-4b12-b3a9-60492a18d757 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.177901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309379c-fc54-4b12-b3a9-60492a18d757 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.179137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309379c-fc54-4b12-b3a9-60492a18d757 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:02.180674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309379c-fc54-4b12-b3a9-60492a18d757 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:02.182764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 123/250] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:02 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:02.189133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309379c-fc54-4b12-b3a9-60492a18d757 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:02.201790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9c17-fbd5-416d-8b37-43759fbc52b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:02.202529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9c17-fbd5-416d-8b37-43759fbc52b2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.202937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9c17-fbd5-416d-8b37-43759fbc52b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.203286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9c17-fbd5-416d-8b37-43759fbc52b2 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.204655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9c17-fbd5-416d-8b37-43759fbc52b2 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:02.206292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9c17-fbd5-416d-8b37-43759fbc52b2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:02.212926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 128/251] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:02 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:02.214241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9c17-fbd5-416d-8b37-43759fbc52b2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:02.291383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:02.295333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309379c-fc54-4b12-b3a9-60492a18d757 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:02.358224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f27cd-cf3b-4e07-9395-a20292bcb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:02.358868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f27cd-cf3b-4e07-9395-a20292bcb176 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.359691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f27cd-cf3b-4e07-9395-a20292bcb176 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.359956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f27cd-cf3b-4e07-9395-a20292bcb176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.365332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f27cd-cf3b-4e07-9395-a20292bcb176 None admin] RBAC: Adding query filter params (role.id=749cda9c1c1448eeba2fa484424d0b15, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c, user.id=f7e96f01a378461780a9a06a0d968a6d) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:02.365670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f27cd-cf3b-4e07-9395-a20292bcb176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:02.367158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f27cd-cf3b-4e07-9395-a20292bcb176 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:02.375845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9c17-fbd5-416d-8b37-43759fbc52b2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:02.379991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 124/252] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:02 2022] GET /identity/v3/role_assignments?user.id=f7e96f01a378461780a9a06a0d968a6d&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=749cda9c1c1448eeba2fa484424d0b15 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:02.382130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660eca5-d5bf-4764-aaa2-d6f0efaf3c12 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.382407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660eca5-d5bf-4764-aaa2-d6f0efaf3c12 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.382676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660eca5-d5bf-4764-aaa2-d6f0efaf3c12 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.390413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 125/253] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:02.396283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da369b-63a5-4aaf-b68a-50a1ca32d175 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.396593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da369b-63a5-4aaf-b68a-50a1ca32d175 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.396822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da369b-63a5-4aaf-b68a-50a1ca32d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.433074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a7da369b-63a5-4aaf-b68a-50a1ca32d175 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:02.434282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a7da369b-63a5-4aaf-b68a-50a1ca32d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:02.455444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc41eb-9769-4a6c-93bc-310400ece2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:02.456115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc41eb-9769-4a6c-93bc-310400ece2cf None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.456389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc41eb-9769-4a6c-93bc-310400ece2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.456653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc41eb-9769-4a6c-93bc-310400ece2cf None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/users/3e930d2239aa4cdc9065c92d513a9267/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.459411 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc41eb-9769-4a6c-93bc-310400ece2cf None admin] RBAC: Authorizing `identity:create_grant(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c, user_id=3e930d2239aa4cdc9065c92d513a9267, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:02.460866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc41eb-9769-4a6c-93bc-310400ece2cf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:02.491685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:02.494965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 129/254] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:21:02 2022] PUT /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/users/3e930d2239aa4cdc9065c92d513a9267/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:02.504281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d32355-75e7-4e11-b31a-04f56a36ea4f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.504613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d32355-75e7-4e11-b31a-04f56a36ea4f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.504838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d32355-75e7-4e11-b31a-04f56a36ea4f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.506610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 130/255] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:02.512616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab193f3-588b-449b-b3bb-8973f97f69eb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.512920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab193f3-588b-449b-b3bb-8973f97f69eb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.513162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab193f3-588b-449b-b3bb-8973f97f69eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.552034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0ab193f3-588b-449b-b3bb-8973f97f69eb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:02.553205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0ab193f3-588b-449b-b3bb-8973f97f69eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:02.576241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 126/256] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:02.651163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 131/257] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:02.985964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da369b-63a5-4aaf-b68a-50a1ca32d175 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.041438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab193f3-588b-449b-b3bb-8973f97f69eb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.140638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da369b-63a5-4aaf-b68a-50a1ca32d175 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.158804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:03.199415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa74320-663b-4c91-b389-b53b191ddccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.200062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa74320-663b-4c91-b389-b53b191ddccd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.200344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa74320-663b-4c91-b389-b53b191ddccd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.200643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa74320-663b-4c91-b389-b53b191ddccd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.215853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa74320-663b-4c91-b389-b53b191ddccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6fa74320-663b-4c91-b389-b53b191ddccd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:03.221044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:03.223162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:03.225114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:03.231113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 127/258] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:21:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:03.237456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa74320-663b-4c91-b389-b53b191ddccd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.283162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:03.304416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab193f3-588b-449b-b3bb-8973f97f69eb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.378443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50198153-a8fe-490e-8214-26420efd7ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.379123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50198153-a8fe-490e-8214-26420efd7ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.379561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50198153-a8fe-490e-8214-26420efd7ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.379844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50198153-a8fe-490e-8214-26420efd7ac5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.404845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50198153-a8fe-490e-8214-26420efd7ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-50198153-a8fe-490e-8214-26420efd7ac5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:03.410478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:03.412595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:03.414570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 132/259] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:03.418650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50198153-a8fe-490e-8214-26420efd7ac5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.437021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa74320-663b-4c91-b389-b53b191ddccd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.497656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dae010-a0af-49a1-abc8-a27c29e28c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.498475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dae010-a0af-49a1-abc8-a27c29e28c46 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.498784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dae010-a0af-49a1-abc8-a27c29e28c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.499056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dae010-a0af-49a1-abc8-a27c29e28c46 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.499768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dae010-a0af-49a1-abc8-a27c29e28c46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:03.500250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dae010-a0af-49a1-abc8-a27c29e28c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.501646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dae010-a0af-49a1-abc8-a27c29e28c46 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.518395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 128/260] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:03.524691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dae010-a0af-49a1-abc8-a27c29e28c46 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.610724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50198153-a8fe-490e-8214-26420efd7ac5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.636424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:03.690812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40b391-6318-4faf-99b1-bc26e00a327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.693990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40b391-6318-4faf-99b1-bc26e00a327b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.696086 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40b391-6318-4faf-99b1-bc26e00a327b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.696367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40b391-6318-4faf-99b1-bc26e00a327b None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.697062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40b391-6318-4faf-99b1-bc26e00a327b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:03.697367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40b391-6318-4faf-99b1-bc26e00a327b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.704615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40b391-6318-4faf-99b1-bc26e00a327b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.721451 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 133/261] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:03.727143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40b391-6318-4faf-99b1-bc26e00a327b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.729833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:03.757550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dae010-a0af-49a1-abc8-a27c29e28c46 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.828563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5014-9c4a-403b-88e6-ea734ca1f3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.829206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5014-9c4a-403b-88e6-ea734ca1f3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.829490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5014-9c4a-403b-88e6-ea734ca1f3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.829765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5014-9c4a-403b-88e6-ea734ca1f3d7 None admin] PATH_INFO: `/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.830955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5014-9c4a-403b-88e6-ea734ca1f3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ef8c04b4e44ff1b27c3782a4afb9a8)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.832409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5014-9c4a-403b-88e6-ea734ca1f3d7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.834309 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 129/262] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:03.839816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5014-9c4a-403b-88e6-ea734ca1f3d7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.910080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40b391-6318-4faf-99b1-bc26e00a327b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.977559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce6419-7f7f-40b2-92fd-fdb84391bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.978205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce6419-7f7f-40b2-92fd-fdb84391bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.978486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce6419-7f7f-40b2-92fd-fdb84391bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.978789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce6419-7f7f-40b2-92fd-fdb84391bbd1 None admin] PATH_INFO: `/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.983436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce6419-7f7f-40b2-92fd-fdb84391bbd1 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ef8c04b4e44ff1b27c3782a4afb9a8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.985597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce6419-7f7f-40b2-92fd-fdb84391bbd1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.987641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 134/263] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/users/a4ef8c04b4e44ff1b27c3782a4afb9a8 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:03.992981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce6419-7f7f-40b2-92fd-fdb84391bbd1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.084304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:04.095131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5014-9c4a-403b-88e6-ea734ca1f3d7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.163577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83709db4-3a8b-43dc-a44d-106e8e1f2ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.164608 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83709db4-3a8b-43dc-a44d-106e8e1f2ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.165128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83709db4-3a8b-43dc-a44d-106e8e1f2ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.165591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83709db4-3a8b-43dc-a44d-106e8e1f2ba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.210238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:04.221767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce6419-7f7f-40b2-92fd-fdb84391bbd1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.256329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83709db4-3a8b-43dc-a44d-106e8e1f2ba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.258159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83709db4-3a8b-43dc-a44d-106e8e1f2ba3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.298204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064eb04-c2d7-40fa-be92-1f47f13d7328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.298866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064eb04-c2d7-40fa-be92-1f47f13d7328 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.299142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064eb04-c2d7-40fa-be92-1f47f13d7328 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.299409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064eb04-c2d7-40fa-be92-1f47f13d7328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.368568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 130/264] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:04.375771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83709db4-3a8b-43dc-a44d-106e8e1f2ba3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.417882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064eb04-c2d7-40fa-be92-1f47f13d7328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.420165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064eb04-c2d7-40fa-be92-1f47f13d7328 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.501216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:04.507142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:04.580618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83709db4-3a8b-43dc-a44d-106e8e1f2ba3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.622078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42bbe1-f78b-469f-af15-68e84168be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.622641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42bbe1-f78b-469f-af15-68e84168be1d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.622951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42bbe1-f78b-469f-af15-68e84168be1d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.623226 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42bbe1-f78b-469f-af15-68e84168be1d None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.623741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 135/265] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:04.624369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42bbe1-f78b-469f-af15-68e84168be1d None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.626220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42bbe1-f78b-469f-af15-68e84168be1d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.628258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 131/266] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:04 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:04.629602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064eb04-c2d7-40fa-be92-1f47f13d7328 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.633640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42bbe1-f78b-469f-af15-68e84168be1d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.787697 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064eb04-c2d7-40fa-be92-1f47f13d7328 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.860449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42bbe1-f78b-469f-af15-68e84168be1d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.867961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612362a-6b0f-4b52-9125-2c86974e7dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.868878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612362a-6b0f-4b52-9125-2c86974e7dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.869352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612362a-6b0f-4b52-9125-2c86974e7dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.869833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612362a-6b0f-4b52-9125-2c86974e7dd3 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.875865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612362a-6b0f-4b52-9125-2c86974e7dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.877584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612362a-6b0f-4b52-9125-2c86974e7dd3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.879478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 136/267] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:04 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:04.880868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395afbcc-2569-48f9-9f4c-8db9b2b67838 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.881337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395afbcc-2569-48f9-9f4c-8db9b2b67838 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.881798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395afbcc-2569-48f9-9f4c-8db9b2b67838 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.883204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 137/268] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:04.888161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:04.894477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67e616-8e3f-4e36-b40f-a6f49e5976f0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.895040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67e616-8e3f-4e36-b40f-a6f49e5976f0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.895524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67e616-8e3f-4e36-b40f-a6f49e5976f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.902706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83482a90-52da-4e83-9636-998605812ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.902706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83482a90-52da-4e83-9636-998605812ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.902706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83482a90-52da-4e83-9636-998605812ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.902706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83482a90-52da-4e83-9636-998605812ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.903047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83482a90-52da-4e83-9636-998605812ab3 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c, user.id=a4ef8c04b4e44ff1b27c3782a4afb9a8) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:04.903047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83482a90-52da-4e83-9636-998605812ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.903047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83482a90-52da-4e83-9636-998605812ab3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.908931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 132/269] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:04 2022] GET /identity/v3/role_assignments?user.id=a4ef8c04b4e44ff1b27c3782a4afb9a8&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=946af2ff291349299db56e09aacb6b03 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:04.910590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83482a90-52da-4e83-9636-998605812ab3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.930832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fd67e616-8e3f-4e36-b40f-a6f49e5976f0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:04.932061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd67e616-8e3f-4e36-b40f-a6f49e5976f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:04.945725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:05.026889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83482a90-52da-4e83-9636-998605812ab3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.070883 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278f497-b0a1-47ce-ab87-0d88b7ecfc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.071502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278f497-b0a1-47ce-ab87-0d88b7ecfc36 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.071847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278f497-b0a1-47ce-ab87-0d88b7ecfc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.072122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278f497-b0a1-47ce-ab87-0d88b7ecfc36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.072914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278f497-b0a1-47ce-ab87-0d88b7ecfc36 None admin] RBAC: Adding query filter params (role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c, user.id=a4ef8c04b4e44ff1b27c3782a4afb9a8) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:05.073217 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278f497-b0a1-47ce-ab87-0d88b7ecfc36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:05.074757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278f497-b0a1-47ce-ab87-0d88b7ecfc36 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:05.082427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 133/270] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:04 2022] GET /identity/v3/role_assignments?user.id=a4ef8c04b4e44ff1b27c3782a4afb9a8&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:05.083748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6d12-b322-476c-a1a5-18a3fbce5747 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.084031 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6d12-b322-476c-a1a5-18a3fbce5747 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.084304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6d12-b322-476c-a1a5-18a3fbce5747 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.085667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 134/271] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:05.091229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec83c0d-95cf-4be8-b86f-f25ad6f8e2e3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.091508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec83c0d-95cf-4be8-b86f-f25ad6f8e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.091785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec83c0d-95cf-4be8-b86f-f25ad6f8e2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.119166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 138/272] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:05.127724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4ec83c0d-95cf-4be8-b86f-f25ad6f8e2e3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:05.129580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4ec83c0d-95cf-4be8-b86f-f25ad6f8e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:05.163376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c0baf-7df9-493f-b3e1-06fa5420d6ab None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.163709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c0baf-7df9-493f-b3e1-06fa5420d6ab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.163934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c0baf-7df9-493f-b3e1-06fa5420d6ab None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.166035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 139/273] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:21:05.172521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3dfb3-4667-4a00-8b38-145e75d1a672 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.172812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3dfb3-4667-4a00-8b38-145e75d1a672 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.173069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3dfb3-4667-4a00-8b38-145e75d1a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.214799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6ec3dfb3-4667-4a00-8b38-145e75d1a672 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:05.216030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ec3dfb3-4667-4a00-8b38-145e75d1a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:05.239359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:05.277981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 135/274] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:05.339089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 140/275] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:05.459073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834524f8-13d9-42b4-a428-480764e68ff0 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.459361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834524f8-13d9-42b4-a428-480764e68ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.459546 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834524f8-13d9-42b4-a428-480764e68ff0 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.461042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 136/276] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:05.466215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65fc0-9d55-40ec-908f-b543e495a8bb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.466508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65fc0-9d55-40ec-908f-b543e495a8bb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.466823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65fc0-9d55-40ec-908f-b543e495a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.491658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b9f65fc0-9d55-40ec-908f-b543e495a8bb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:05.492845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9f65fc0-9d55-40ec-908f-b543e495a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:05.539766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834524f8-13d9-42b4-a428-480764e68ff0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.573858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:05.582719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 141/277] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:05.582719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65fc0-9d55-40ec-908f-b543e495a8bb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.660449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834524f8-13d9-42b4-a428-480764e68ff0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.699044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65fc0-9d55-40ec-908f-b543e495a8bb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.700751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4407fb-ce34-487e-bf93-da0b2879cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.701944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4407fb-ce34-487e-bf93-da0b2879cbda None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.701944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4407fb-ce34-487e-bf93-da0b2879cbda None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.701944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4407fb-ce34-487e-bf93-da0b2879cbda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.703663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4407fb-ce34-487e-bf93-da0b2879cbda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:05.705247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4407fb-ce34-487e-bf93-da0b2879cbda None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:05.707034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 137/278] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:05.707940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4407fb-ce34-487e-bf93-da0b2879cbda None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.738672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6191e-eadd-433e-b1ee-5eb5ffe537a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.739393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6191e-eadd-433e-b1ee-5eb5ffe537a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.739677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6191e-eadd-433e-b1ee-5eb5ffe537a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.739952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6191e-eadd-433e-b1ee-5eb5ffe537a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.750803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6191e-eadd-433e-b1ee-5eb5ffe537a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dff6191e-eadd-433e-b1ee-5eb5ffe537a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:05.755648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:05.756537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:05.757332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 142/279] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:05.757976 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6191e-eadd-433e-b1ee-5eb5ffe537a9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.768771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:05.820149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:05.821530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4407fb-ce34-487e-bf93-da0b2879cbda None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.858430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a033f-6ab0-46a4-a89c-36bef12dfd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.859403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a033f-6ab0-46a4-a89c-36bef12dfd19 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.859960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a033f-6ab0-46a4-a89c-36bef12dfd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.860383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a033f-6ab0-46a4-a89c-36bef12dfd19 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.863306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6191e-eadd-433e-b1ee-5eb5ffe537a9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.871397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a033f-6ab0-46a4-a89c-36bef12dfd19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c92a033f-6ab0-46a4-a89c-36bef12dfd19 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:05.876784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:05.877669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 138/280] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:05.883288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a033f-6ab0-46a4-a89c-36bef12dfd19 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.898936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09cfc1-1a2b-4d36-aa0c-a25d01db3ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.899542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09cfc1-1a2b-4d36-aa0c-a25d01db3ad0 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.899817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09cfc1-1a2b-4d36-aa0c-a25d01db3ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.900090 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09cfc1-1a2b-4d36-aa0c-a25d01db3ad0 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.900729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09cfc1-1a2b-4d36-aa0c-a25d01db3ad0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:05.902188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09cfc1-1a2b-4d36-aa0c-a25d01db3ad0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:05.923452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 143/281] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:21:05 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:05.924281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09cfc1-1a2b-4d36-aa0c-a25d01db3ad0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.004529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a033f-6ab0-46a4-a89c-36bef12dfd19 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.019086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:06.041950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4ac65-192c-44bd-91c7-a0cedb477581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.042572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4ac65-192c-44bd-91c7-a0cedb477581 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.042892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4ac65-192c-44bd-91c7-a0cedb477581 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.043155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4ac65-192c-44bd-91c7-a0cedb477581 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.043843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4ac65-192c-44bd-91c7-a0cedb477581 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:06.044143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4ac65-192c-44bd-91c7-a0cedb477581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.045551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4ac65-192c-44bd-91c7-a0cedb477581 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:06.045886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09cfc1-1a2b-4d36-aa0c-a25d01db3ad0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.055191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 139/282] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:06.056050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4ac65-192c-44bd-91c7-a0cedb477581 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.070115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:06.092153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6ae7e-43b9-43cd-9424-8f27f734d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.092802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6ae7e-43b9-43cd-9424-8f27f734d981 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.093092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6ae7e-43b9-43cd-9424-8f27f734d981 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.093478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6ae7e-43b9-43cd-9424-8f27f734d981 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.106183 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6ae7e-43b9-43cd-9424-8f27f734d981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-27e6ae7e-43b9-43cd-9424-8f27f734d981 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:06.112841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:06.113956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:06.114983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 144/283] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:06.115711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6ae7e-43b9-43cd-9424-8f27f734d981 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.190333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4ac65-192c-44bd-91c7-a0cedb477581 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.235948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288b372-6fcc-46ef-af3c-d5e36e49deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.236562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288b372-6fcc-46ef-af3c-d5e36e49deb6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.236845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288b372-6fcc-46ef-af3c-d5e36e49deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.237117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288b372-6fcc-46ef-af3c-d5e36e49deb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.237797 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288b372-6fcc-46ef-af3c-d5e36e49deb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:06.238099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288b372-6fcc-46ef-af3c-d5e36e49deb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.238577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6ae7e-43b9-43cd-9424-8f27f734d981 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.239582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288b372-6fcc-46ef-af3c-d5e36e49deb6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:06.251108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 140/284] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:06.251855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288b372-6fcc-46ef-af3c-d5e36e49deb6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.286444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cea0d-ae71-41d1-b8b9-72e74b8fe462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.287032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cea0d-ae71-41d1-b8b9-72e74b8fe462 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.287423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cea0d-ae71-41d1-b8b9-72e74b8fe462 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.287702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cea0d-ae71-41d1-b8b9-72e74b8fe462 None admin] PATH_INFO: `/v3/users/5b0fdbb6d50c4c38a0a1407ee9728844` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.298925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:06.306356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cea0d-ae71-41d1-b8b9-72e74b8fe462 None admin] RBAC: Authorizing `identity:get_user(user_id=5b0fdbb6d50c4c38a0a1407ee9728844)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.308247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cea0d-ae71-41d1-b8b9-72e74b8fe462 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:06.310774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 145/285] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:06 2022] GET /identity/v3/users/5b0fdbb6d50c4c38a0a1407ee9728844 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:06.311744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cea0d-ae71-41d1-b8b9-72e74b8fe462 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.351948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:06.383365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288b372-6fcc-46ef-af3c-d5e36e49deb6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.424552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999da34-c5eb-406e-addc-ad536b512c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.425211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999da34-c5eb-406e-addc-ad536b512c21 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.425606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999da34-c5eb-406e-addc-ad536b512c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.425952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999da34-c5eb-406e-addc-ad536b512c21 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.426884 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999da34-c5eb-406e-addc-ad536b512c21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:06.427263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999da34-c5eb-406e-addc-ad536b512c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.428887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999da34-c5eb-406e-addc-ad536b512c21 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:06.431027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cea0d-ae71-41d1-b8b9-72e74b8fe462 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.438528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 141/286] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:06.443669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999da34-c5eb-406e-addc-ad536b512c21 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.469308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671635d-0986-4696-bd09-cd01b980d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.470331 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671635d-0986-4696-bd09-cd01b980d9fa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.471124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671635d-0986-4696-bd09-cd01b980d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.471572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671635d-0986-4696-bd09-cd01b980d9fa None admin] PATH_INFO: `/v3/users/f7e96f01a378461780a9a06a0d968a6d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.473134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671635d-0986-4696-bd09-cd01b980d9fa None admin] RBAC: Authorizing `identity:get_user(user_id=f7e96f01a378461780a9a06a0d968a6d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.474874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671635d-0986-4696-bd09-cd01b980d9fa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:06.476958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 146/287] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:06 2022] GET /identity/v3/users/f7e96f01a378461780a9a06a0d968a6d => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:06.477945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671635d-0986-4696-bd09-cd01b980d9fa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.558705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:06.563848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999da34-c5eb-406e-addc-ad536b512c21 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.603789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671635d-0986-4696-bd09-cd01b980d9fa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.605781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:06.611220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ca18f-fbb4-4e34-93a0-0e7e83dbdeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.611836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ca18f-fbb4-4e34-93a0-0e7e83dbdeda None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.612118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ca18f-fbb4-4e34-93a0-0e7e83dbdeda None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.612393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ca18f-fbb4-4e34-93a0-0e7e83dbdeda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.613122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ca18f-fbb4-4e34-93a0-0e7e83dbdeda None admin] RBAC: Adding query filter params (role.id=75f020c060fa465d828d5fcb8d48ad60, user.id=5b0fdbb6d50c4c38a0a1407ee9728844, scope.system=all) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:06.613427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ca18f-fbb4-4e34-93a0-0e7e83dbdeda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.615463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ca18f-fbb4-4e34-93a0-0e7e83dbdeda None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:06.622177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 142/288] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 31 11:21:06 2022] GET /identity/v3/role_assignments?user.id=5b0fdbb6d50c4c38a0a1407ee9728844&scope.system=all&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:06.623650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ca18f-fbb4-4e34-93a0-0e7e83dbdeda None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.648027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bee9-60dc-4210-a8a8-d7468214123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.649137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bee9-60dc-4210-a8a8-d7468214123d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.649686 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bee9-60dc-4210-a8a8-d7468214123d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.650187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bee9-60dc-4210-a8a8-d7468214123d None admin] PATH_INFO: `/v3/users/3e930d2239aa4cdc9065c92d513a9267` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.651803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84bee9-60dc-4210-a8a8-d7468214123d None admin] RBAC: Authorizing `identity:get_user(user_id=3e930d2239aa4cdc9065c92d513a9267)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.653836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84bee9-60dc-4210-a8a8-d7468214123d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:06.655898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 147/289] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:06 2022] GET /identity/v3/users/3e930d2239aa4cdc9065c92d513a9267 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:06.666720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bee9-60dc-4210-a8a8-d7468214123d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.797145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ca18f-fbb4-4e34-93a0-0e7e83dbdeda None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.840841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8423018-8558-4892-8398-748f76108f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.841341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423018-8558-4892-8398-748f76108f98 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.841628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423018-8558-4892-8398-748f76108f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.841901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423018-8558-4892-8398-748f76108f98 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.844111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8423018-8558-4892-8398-748f76108f98 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.845554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8423018-8558-4892-8398-748f76108f98 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:06.847488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 143/290] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:06 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:06.859739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8423018-8558-4892-8398-748f76108f98 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.876149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bee9-60dc-4210-a8a8-d7468214123d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.917589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:06.938419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d75e4-4ba5-42fe-9b24-60fd0a8a9bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.939115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d75e4-4ba5-42fe-9b24-60fd0a8a9bdc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.939398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d75e4-4ba5-42fe-9b24-60fd0a8a9bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.939718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d75e4-4ba5-42fe-9b24-60fd0a8a9bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.992786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:07.046175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d75e4-4ba5-42fe-9b24-60fd0a8a9bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:07.047914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d75e4-4ba5-42fe-9b24-60fd0a8a9bdc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:07.049798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8423018-8558-4892-8398-748f76108f98 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:07.087426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c2dbe-104c-4508-849f-b99acb7c2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:07.088374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c2dbe-104c-4508-849f-b99acb7c2a8d None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.088820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c2dbe-104c-4508-849f-b99acb7c2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.089231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c2dbe-104c-4508-849f-b99acb7c2a8d None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/users/f7e96f01a378461780a9a06a0d968a6d/roles/749cda9c1c1448eeba2fa484424d0b15` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.091492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c2dbe-104c-4508-849f-b99acb7c2a8d None admin] RBAC: Authorizing `identity:create_grant(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c, user_id=f7e96f01a378461780a9a06a0d968a6d, role_id=749cda9c1c1448eeba2fa484424d0b15)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:07.093069 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c2dbe-104c-4508-849f-b99acb7c2a8d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:07.112937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 144/291] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:21:06 2022] PUT /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/users/f7e96f01a378461780a9a06a0d968a6d/roles/749cda9c1c1448eeba2fa484424d0b15 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:07.212784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 148/292] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 11:21:07.220025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c2dbe-104c-4508-849f-b99acb7c2a8d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:07.326021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:07.340572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c2dbe-104c-4508-849f-b99acb7c2a8d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:07.383201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fcc63-5d17-4dbf-820a-c16a0cadfb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:07.384160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fcc63-5d17-4dbf-820a-c16a0cadfb2e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.384583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fcc63-5d17-4dbf-820a-c16a0cadfb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.385000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fcc63-5d17-4dbf-820a-c16a0cadfb2e None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.386393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fcc63-5d17-4dbf-820a-c16a0cadfb2e None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:07.388082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fcc63-5d17-4dbf-820a-c16a0cadfb2e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:07.390312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 145/293] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:07 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:07.399842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d75e4-4ba5-42fe-9b24-60fd0a8a9bdc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:07.475744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:07.510260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d75e4-4ba5-42fe-9b24-60fd0a8a9bdc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:07.547349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196728d-3f2c-430c-9b3f-95104bcc832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:07.547957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196728d-3f2c-430c-9b3f-95104bcc832e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.548240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196728d-3f2c-430c-9b3f-95104bcc832e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.548516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196728d-3f2c-430c-9b3f-95104bcc832e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.549247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196728d-3f2c-430c-9b3f-95104bcc832e None admin] RBAC: Adding query filter params (role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c, user.id=3e930d2239aa4cdc9065c92d513a9267) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:07.549556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196728d-3f2c-430c-9b3f-95104bcc832e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:07.551157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196728d-3f2c-430c-9b3f-95104bcc832e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:07.557234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 149/294] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:07 2022] GET /identity/v3/role_assignments?user.id=3e930d2239aa4cdc9065c92d513a9267&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:08.296296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275c1e8-04b2-413a-b615-1cfa4f1df1b5 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.297947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275c1e8-04b2-413a-b615-1cfa4f1df1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.298429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275c1e8-04b2-413a-b615-1cfa4f1df1b5 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.300308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 146/295] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:08.305953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0de90-1c8e-48b5-b886-18efc8693729 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.306488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0de90-1c8e-48b5-b886-18efc8693729 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.306995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0de90-1c8e-48b5-b886-18efc8693729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.326570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e1e0de90-1c8e-48b5-b886-18efc8693729 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:08.328400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e1e0de90-1c8e-48b5-b886-18efc8693729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:08.349168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bd0c5-647a-4d1a-89cd-b425007922e0 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.349478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bd0c5-647a-4d1a-89cd-b425007922e0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.349718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bd0c5-647a-4d1a-89cd-b425007922e0 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.351583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 147/296] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:21:08.356881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3b8b4-2696-468d-ba2c-463bf31ee244 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.357166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3b8b4-2696-468d-ba2c-463bf31ee244 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.357441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3b8b4-2696-468d-ba2c-463bf31ee244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.379447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-94a3b8b4-2696-468d-ba2c-463bf31ee244 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:08.381022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-94a3b8b4-2696-468d-ba2c-463bf31ee244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:08.416526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 150/297] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:08.465715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 148/298] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:08.626457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea384e-e04f-4e59-88f0-2f837582d210 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.626642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea384e-e04f-4e59-88f0-2f837582d210 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.626952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea384e-e04f-4e59-88f0-2f837582d210 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.628578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 151/299] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:08.633667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe18c44-9548-4499-b4dd-4f709b1f4215 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.633947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe18c44-9548-4499-b4dd-4f709b1f4215 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.634216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe18c44-9548-4499-b4dd-4f709b1f4215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.653278 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0fe18c44-9548-4499-b4dd-4f709b1f4215 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:08.654438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0fe18c44-9548-4499-b4dd-4f709b1f4215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:08.705165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea384e-e04f-4e59-88f0-2f837582d210 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:08.735313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 149/300] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:08.740012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe18c44-9548-4499-b4dd-4f709b1f4215 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:08.761464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:08.787371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:08.827577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea384e-e04f-4e59-88f0-2f837582d210 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:08.855076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe18c44-9548-4499-b4dd-4f709b1f4215 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:08.863295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed4dc0-0ff2-4f53-ae50-7afd9624ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:08.864067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed4dc0-0ff2-4f53-ae50-7afd9624ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.864445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed4dc0-0ff2-4f53-ae50-7afd9624ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.864837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed4dc0-0ff2-4f53-ae50-7afd9624ccb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.876331 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed4dc0-0ff2-4f53-ae50-7afd9624ccb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-10ed4dc0-0ff2-4f53-ae50-7afd9624ccb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:08.881376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:08.882483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:08.883501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:08.889808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 152/301] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:08.891371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed4dc0-0ff2-4f53-ae50-7afd9624ccb4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:08.897597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba5007-ab3d-45a5-8a34-955700de2e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:08.898487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba5007-ab3d-45a5-8a34-955700de2e60 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.898938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba5007-ab3d-45a5-8a34-955700de2e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.899416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba5007-ab3d-45a5-8a34-955700de2e60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.900700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba5007-ab3d-45a5-8a34-955700de2e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:08.902507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba5007-ab3d-45a5-8a34-955700de2e60 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:08.904432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 150/302] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:08.910196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba5007-ab3d-45a5-8a34-955700de2e60 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:08.997589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed4dc0-0ff2-4f53-ae50-7afd9624ccb4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:09.008401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:09.022616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba5007-ab3d-45a5-8a34-955700de2e60 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:09.024732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:09.037918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a60b8f-e9ce-40bf-990f-37876aa36364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:09.038526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60b8f-e9ce-40bf-990f-37876aa36364 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.038850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60b8f-e9ce-40bf-990f-37876aa36364 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.039118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60b8f-e9ce-40bf-990f-37876aa36364 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.039788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a60b8f-e9ce-40bf-990f-37876aa36364 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:09.040091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a60b8f-e9ce-40bf-990f-37876aa36364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:09.041479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a60b8f-e9ce-40bf-990f-37876aa36364 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:09.050850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 153/303] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:09.051484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a60b8f-e9ce-40bf-990f-37876aa36364 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:09.065238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd468-30cc-4da9-afa7-2ccdcf2be3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:09.065880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd468-30cc-4da9-afa7-2ccdcf2be3ad None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.066157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd468-30cc-4da9-afa7-2ccdcf2be3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.066427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd468-30cc-4da9-afa7-2ccdcf2be3ad None admin] PATH_INFO: `/v3/groups` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.067193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbd468-30cc-4da9-afa7-2ccdcf2be3ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:09.068515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbd468-30cc-4da9-afa7-2ccdcf2be3ad None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:09.084737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 151/304] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Aug 31 11:21:08 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:09.085907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd468-30cc-4da9-afa7-2ccdcf2be3ad None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:09.197304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a60b8f-e9ce-40bf-990f-37876aa36364 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:09.235572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd468-30cc-4da9-afa7-2ccdcf2be3ad None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:09.242715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17689c-bec4-4b44-aee6-c0da936d9a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:09.243366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17689c-bec4-4b44-aee6-c0da936d9a17 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.244049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17689c-bec4-4b44-aee6-c0da936d9a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.244049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17689c-bec4-4b44-aee6-c0da936d9a17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.257332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17689c-bec4-4b44-aee6-c0da936d9a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7c17689c-bec4-4b44-aee6-c0da936d9a17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:09.265102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:09.266001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:09.266837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 154/305] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:09.272774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17689c-bec4-4b44-aee6-c0da936d9a17 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:09.279857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e20431-2540-4737-a056-20b7689e73e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:09.280499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20431-2540-4737-a056-20b7689e73e8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.281377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20431-2540-4737-a056-20b7689e73e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.281640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20431-2540-4737-a056-20b7689e73e8 None admin] PATH_INFO: `/v3/users/8b4e0bba82b24c82a473144c71387fba` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.297638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e20431-2540-4737-a056-20b7689e73e8 None admin] RBAC: Authorizing `identity:get_user(user_id=8b4e0bba82b24c82a473144c71387fba)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:09.299674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e20431-2540-4737-a056-20b7689e73e8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:09.301272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 152/306] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:09 2022] GET /identity/v3/users/8b4e0bba82b24c82a473144c71387fba => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:09.308305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e20431-2540-4737-a056-20b7689e73e8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:09.312613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:09.338942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:09.394464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17689c-bec4-4b44-aee6-c0da936d9a17 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:09.435558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e20431-2540-4737-a056-20b7689e73e8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:09.439637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c5d43-006a-4613-a304-17cbf27978d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:09.440315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c5d43-006a-4613-a304-17cbf27978d5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.440662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c5d43-006a-4613-a304-17cbf27978d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.440993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c5d43-006a-4613-a304-17cbf27978d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.441719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c5d43-006a-4613-a304-17cbf27978d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:09.442082 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c5d43-006a-4613-a304-17cbf27978d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:09.444110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c5d43-006a-4613-a304-17cbf27978d5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:09.456376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 155/307] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:09.461685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c5d43-006a-4613-a304-17cbf27978d5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:09.475212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb401f-3cbd-4f92-a86d-c0111e3a651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:09.476051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb401f-3cbd-4f92-a86d-c0111e3a651e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.476433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb401f-3cbd-4f92-a86d-c0111e3a651e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.476775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb401f-3cbd-4f92-a86d-c0111e3a651e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.477611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb401f-3cbd-4f92-a86d-c0111e3a651e None admin] RBAC: Adding query filter params (role.id=749cda9c1c1448eeba2fa484424d0b15, user.id=8b4e0bba82b24c82a473144c71387fba, scope.system=all) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:09.478082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb401f-3cbd-4f92-a86d-c0111e3a651e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:09.479741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb401f-3cbd-4f92-a86d-c0111e3a651e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:09.486380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 153/308] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 31 11:21:09 2022] GET /identity/v3/role_assignments?user.id=8b4e0bba82b24c82a473144c71387fba&scope.system=all&role.id=749cda9c1c1448eeba2fa484424d0b15 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:09.487674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948c1b-f976-43fa-9406-dfdf59cb2419 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.487956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948c1b-f976-43fa-9406-dfdf59cb2419 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.488232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948c1b-f976-43fa-9406-dfdf59cb2419 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.489569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 154/309] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:09.495332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09150b38-710d-404c-aa90-cd0c57c83fcd None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.495632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09150b38-710d-404c-aa90-cd0c57c83fcd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.495877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09150b38-710d-404c-aa90-cd0c57c83fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.522024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-09150b38-710d-404c-aa90-cd0c57c83fcd None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:09.524077 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-09150b38-710d-404c-aa90-cd0c57c83fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:09.595379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:09.602995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c5d43-006a-4613-a304-17cbf27978d5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:09.607078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 155/310] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:09.615064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:09.644469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f5f35-437b-4bc0-b674-15c117c1b826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:09.645342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f5f35-437b-4bc0-b674-15c117c1b826 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.645766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f5f35-437b-4bc0-b674-15c117c1b826 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.646180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f5f35-437b-4bc0-b674-15c117c1b826 None admin] PATH_INFO: `/v3/users/5b0fdbb6d50c4c38a0a1407ee9728844` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.647578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f5f35-437b-4bc0-b674-15c117c1b826 None admin] RBAC: Authorizing `identity:get_user(user_id=5b0fdbb6d50c4c38a0a1407ee9728844)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:09.649158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f5f35-437b-4bc0-b674-15c117c1b826 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:09.651208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 156/311] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:09 2022] GET /identity/v3/users/5b0fdbb6d50c4c38a0a1407ee9728844 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:09.659767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09150b38-710d-404c-aa90-cd0c57c83fcd None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:09.767135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09150b38-710d-404c-aa90-cd0c57c83fcd None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:09.803002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28abc-e725-4833-8029-7516ed1ff7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:09.803651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28abc-e725-4833-8029-7516ed1ff7b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.803923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28abc-e725-4833-8029-7516ed1ff7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.804189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28abc-e725-4833-8029-7516ed1ff7b0 None admin] PATH_INFO: `/v3/system/users/5b0fdbb6d50c4c38a0a1407ee9728844/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.805599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d28abc-e725-4833-8029-7516ed1ff7b0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5b0fdbb6d50c4c38a0a1407ee9728844, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:09.807053 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d28abc-e725-4833-8029-7516ed1ff7b0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:09.822895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 156/312] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Aug 31 11:21:09 2022] PUT /identity/v3/system/users/5b0fdbb6d50c4c38a0a1407ee9728844/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:09.890286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f5f35-437b-4bc0-b674-15c117c1b826 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.004541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f5f35-437b-4bc0-b674-15c117c1b826 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:10.040429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2b37-fa0a-4e97-b147-d24ab7b59431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:10.040985 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2b37-fa0a-4e97-b147-d24ab7b59431 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:10.041266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2b37-fa0a-4e97-b147-d24ab7b59431 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:10.041539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2b37-fa0a-4e97-b147-d24ab7b59431 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:10.052151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c2b37-fa0a-4e97-b147-d24ab7b59431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f03c2b37-fa0a-4e97-b147-d24ab7b59431 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:10.057475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:10.058338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:10.059158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 157/313] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:10.065241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28abc-e725-4833-8029-7516ed1ff7b0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.129871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:10.170964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28abc-e725-4833-8029-7516ed1ff7b0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:10.206443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5bd9-0019-497c-9d69-4bc2b89286e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:10.207130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5bd9-0019-497c-9d69-4bc2b89286e5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:10.207405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5bd9-0019-497c-9d69-4bc2b89286e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:10.207673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5bd9-0019-497c-9d69-4bc2b89286e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:10.208337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af5bd9-0019-497c-9d69-4bc2b89286e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:10.208635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af5bd9-0019-497c-9d69-4bc2b89286e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:10.210010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af5bd9-0019-497c-9d69-4bc2b89286e5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:10.219064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 157/314] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:10.228028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2b37-fa0a-4e97-b147-d24ab7b59431 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.265963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:10.335313 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2b37-fa0a-4e97-b147-d24ab7b59431 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:10.370297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b6a22-d9e0-4089-b58f-1f677ffcf77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:10.370950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b6a22-d9e0-4089-b58f-1f677ffcf77f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:10.371225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b6a22-d9e0-4089-b58f-1f677ffcf77f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:10.371495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b6a22-d9e0-4089-b58f-1f677ffcf77f None admin] PATH_INFO: `/v3/users/f7e96f01a378461780a9a06a0d968a6d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:10.372625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b6a22-d9e0-4089-b58f-1f677ffcf77f None admin] RBAC: Authorizing `identity:get_user(user_id=f7e96f01a378461780a9a06a0d968a6d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:10.374077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b6a22-d9e0-4089-b58f-1f677ffcf77f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:10.376598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 158/315] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:10 2022] GET /identity/v3/users/f7e96f01a378461780a9a06a0d968a6d => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:10.382677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5bd9-0019-497c-9d69-4bc2b89286e5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.489804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5bd9-0019-497c-9d69-4bc2b89286e5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:10.514040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:10.524897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a77c-c6c0-4008-bc1e-af67e8b471cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:10.525563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a77c-c6c0-4008-bc1e-af67e8b471cd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:10.525898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a77c-c6c0-4008-bc1e-af67e8b471cd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:10.526174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a77c-c6c0-4008-bc1e-af67e8b471cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:10.601948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927a77c-c6c0-4008-bc1e-af67e8b471cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:10.603821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927a77c-c6c0-4008-bc1e-af67e8b471cd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:10.712090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 158/316] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 11:21:10.717422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b6a22-d9e0-4089-b58f-1f677ffcf77f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.819828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b6a22-d9e0-4089-b58f-1f677ffcf77f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:10.828325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:10.856461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87199347-56b9-4ea8-bbc3-6911d047ed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:10.857055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87199347-56b9-4ea8-bbc3-6911d047ed93 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:10.857329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87199347-56b9-4ea8-bbc3-6911d047ed93 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:10.857658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87199347-56b9-4ea8-bbc3-6911d047ed93 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:10.858837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87199347-56b9-4ea8-bbc3-6911d047ed93 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:10.861040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87199347-56b9-4ea8-bbc3-6911d047ed93 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:10.867077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 159/317] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:10 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:10.869006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a77c-c6c0-4008-bc1e-af67e8b471cd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.894721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:10.978442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a77c-c6c0-4008-bc1e-af67e8b471cd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:11.016737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9938767-3ba6-438b-8f4e-c75cc7227f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:11.017681 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9938767-3ba6-438b-8f4e-c75cc7227f32 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.018156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9938767-3ba6-438b-8f4e-c75cc7227f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.018624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9938767-3ba6-438b-8f4e-c75cc7227f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.019615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9938767-3ba6-438b-8f4e-c75cc7227f32 None admin] RBAC: Adding query filter params (role.id=749cda9c1c1448eeba2fa484424d0b15, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c, user.id=f7e96f01a378461780a9a06a0d968a6d) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:11.020120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9938767-3ba6-438b-8f4e-c75cc7227f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:11.021752 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9938767-3ba6-438b-8f4e-c75cc7227f32 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:11.028141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 159/318] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:10 2022] GET /identity/v3/role_assignments?user.id=f7e96f01a378461780a9a06a0d968a6d&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=749cda9c1c1448eeba2fa484424d0b15 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:11.203786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e693e87-f834-4f77-bbaa-691926260057 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.203786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e693e87-f834-4f77-bbaa-691926260057 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.204080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e693e87-f834-4f77-bbaa-691926260057 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.205408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 160/319] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:21:11.210594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d0b89-70ee-4632-a449-0cb1bce88143 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.210925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d0b89-70ee-4632-a449-0cb1bce88143 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.211205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d0b89-70ee-4632-a449-0cb1bce88143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.231009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-df2d0b89-70ee-4632-a449-0cb1bce88143 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:11.232219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-df2d0b89-70ee-4632-a449-0cb1bce88143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.305756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 160/320] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:11.505437 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406c429-a897-4d14-8a97-6ada06574168 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.505812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406c429-a897-4d14-8a97-6ada06574168 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.505993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406c429-a897-4d14-8a97-6ada06574168 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.507493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 161/321] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:11.512532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7170a0-08d3-441a-ac31-4d6358bb6142 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.512972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7170a0-08d3-441a-ac31-4d6358bb6142 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.513063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7170a0-08d3-441a-ac31-4d6358bb6142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.532454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7e7170a0-08d3-441a-ac31-4d6358bb6142 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:11.533621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7e7170a0-08d3-441a-ac31-4d6358bb6142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.547084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:11.572848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406c429-a897-4d14-8a97-6ada06574168 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:11.603922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 161/322] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:11.680016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406c429-a897-4d14-8a97-6ada06574168 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:11.715645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e63342-dcb6-4515-840b-570228eff4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:11.716254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e63342-dcb6-4515-840b-570228eff4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.716532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e63342-dcb6-4515-840b-570228eff4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.716801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e63342-dcb6-4515-840b-570228eff4f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.717888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e63342-dcb6-4515-840b-570228eff4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:11.720170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e63342-dcb6-4515-840b-570228eff4f5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:11.722195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 162/323] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:11.727546 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7170a0-08d3-441a-ac31-4d6358bb6142 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:11.819151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d74db-9250-4ba7-8886-2828a4ecff04 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.819435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d74db-9250-4ba7-8886-2828a4ecff04 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.819602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d74db-9250-4ba7-8886-2828a4ecff04 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.820941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 163/324] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:11.825839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d60080-393e-455a-85e9-fe08eaa4153c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.826118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d60080-393e-455a-85e9-fe08eaa4153c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.826491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d60080-393e-455a-85e9-fe08eaa4153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.829196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7170a0-08d3-441a-ac31-4d6358bb6142 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:11.845022 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-97d60080-393e-455a-85e9-fe08eaa4153c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:11.846481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-97d60080-393e-455a-85e9-fe08eaa4153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.866206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1bc8-1ccc-4ace-8e5b-b93417d08976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:11.866852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1bc8-1ccc-4ace-8e5b-b93417d08976 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.867131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1bc8-1ccc-4ace-8e5b-b93417d08976 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.867402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1bc8-1ccc-4ace-8e5b-b93417d08976 None admin] PATH_INFO: `/v3/groups` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.868478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e1bc8-1ccc-4ace-8e5b-b93417d08976 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:11.869899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e1bc8-1ccc-4ace-8e5b-b93417d08976 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:11.882406 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:11.885808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 162/325] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Aug 31 11:21:11 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:11.886610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1bc8-1ccc-4ace-8e5b-b93417d08976 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:11.907281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:11.929293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 164/326] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:12.011077 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1bc8-1ccc-4ace-8e5b-b93417d08976 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.050206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc096d5-3391-4dd3-9907-4c827f92c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.050866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc096d5-3391-4dd3-9907-4c827f92c253 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.051148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc096d5-3391-4dd3-9907-4c827f92c253 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.051412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc096d5-3391-4dd3-9907-4c827f92c253 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.061949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc096d5-3391-4dd3-9907-4c827f92c253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fdc096d5-3391-4dd3-9907-4c827f92c253 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:12.068240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:12.069110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:12.070140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 163/327] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:12.075212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d60080-393e-455a-85e9-fe08eaa4153c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.188429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d60080-393e-455a-85e9-fe08eaa4153c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.201080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc096d5-3391-4dd3-9907-4c827f92c253 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.233962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061f954-c9ce-4249-ad9b-ce8c3c3e718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.234640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f954-c9ce-4249-ad9b-ce8c3c3e718d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.235063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f954-c9ce-4249-ad9b-ce8c3c3e718d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.235345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f954-c9ce-4249-ad9b-ce8c3c3e718d None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.236026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061f954-c9ce-4249-ad9b-ce8c3c3e718d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:12.236327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061f954-c9ce-4249-ad9b-ce8c3c3e718d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.237726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061f954-c9ce-4249-ad9b-ce8c3c3e718d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.246761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 165/328] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:12.256078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061f954-c9ce-4249-ad9b-ce8c3c3e718d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.295523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:12.295821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:12.335967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc096d5-3391-4dd3-9907-4c827f92c253 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.376040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af706144-d8b3-4b4d-adf5-383d85784e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.377161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af706144-d8b3-4b4d-adf5-383d85784e01 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.377791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af706144-d8b3-4b4d-adf5-383d85784e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.378134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af706144-d8b3-4b4d-adf5-383d85784e01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.395048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061f954-c9ce-4249-ad9b-ce8c3c3e718d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.399325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af706144-d8b3-4b4d-adf5-383d85784e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-af706144-d8b3-4b4d-adf5-383d85784e01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:12.404649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:12.405564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:12.410916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 164/329] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:12.413438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af706144-d8b3-4b4d-adf5-383d85784e01 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.435923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab373bc-6d2c-4ff1-b119-f654e118642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.436491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab373bc-6d2c-4ff1-b119-f654e118642c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.436768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab373bc-6d2c-4ff1-b119-f654e118642c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.437782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab373bc-6d2c-4ff1-b119-f654e118642c None admin] PATH_INFO: `/v3/users/8b4e0bba82b24c82a473144c71387fba` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.439473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab373bc-6d2c-4ff1-b119-f654e118642c None admin] RBAC: Authorizing `identity:get_user(user_id=8b4e0bba82b24c82a473144c71387fba)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.440917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab373bc-6d2c-4ff1-b119-f654e118642c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.443516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 166/330] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:12 2022] GET /identity/v3/users/8b4e0bba82b24c82a473144c71387fba => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:12.448578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab373bc-6d2c-4ff1-b119-f654e118642c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.569247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af706144-d8b3-4b4d-adf5-383d85784e01 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.582361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:12.587190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab373bc-6d2c-4ff1-b119-f654e118642c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.606025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:12.618563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0091c-e39a-4983-bcf0-012682bcb323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.619642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0091c-e39a-4983-bcf0-012682bcb323 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.619873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0091c-e39a-4983-bcf0-012682bcb323 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.620234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0091c-e39a-4983-bcf0-012682bcb323 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.621032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0091c-e39a-4983-bcf0-012682bcb323 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:12.621364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0091c-e39a-4983-bcf0-012682bcb323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.622972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0091c-e39a-4983-bcf0-012682bcb323 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.632445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566d0f7-0b17-4ed3-bc68-919ca475ea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.632676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 165/331] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:12.633544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566d0f7-0b17-4ed3-bc68-919ca475ea97 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.633991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566d0f7-0b17-4ed3-bc68-919ca475ea97 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.634450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566d0f7-0b17-4ed3-bc68-919ca475ea97 None admin] PATH_INFO: `/v3/system/users/8b4e0bba82b24c82a473144c71387fba/roles/749cda9c1c1448eeba2fa484424d0b15` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.636148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566d0f7-0b17-4ed3-bc68-919ca475ea97 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8b4e0bba82b24c82a473144c71387fba, role_id=749cda9c1c1448eeba2fa484424d0b15)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.637741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566d0f7-0b17-4ed3-bc68-919ca475ea97 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.638124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0091c-e39a-4983-bcf0-012682bcb323 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.652426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 167/332] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Aug 31 11:21:12 2022] PUT /identity/v3/system/users/8b4e0bba82b24c82a473144c71387fba/roles/749cda9c1c1448eeba2fa484424d0b15 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:12.771153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0091c-e39a-4983-bcf0-012682bcb323 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.811428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0aedd-4d13-4dff-b92a-bd4c6401427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.812937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0aedd-4d13-4dff-b92a-bd4c6401427d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.813222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0aedd-4d13-4dff-b92a-bd4c6401427d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.813688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0aedd-4d13-4dff-b92a-bd4c6401427d None admin] PATH_INFO: `/v3/users/5b0fdbb6d50c4c38a0a1407ee9728844` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.814937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0aedd-4d13-4dff-b92a-bd4c6401427d None admin] RBAC: Authorizing `identity:get_user(user_id=5b0fdbb6d50c4c38a0a1407ee9728844)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.816595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0aedd-4d13-4dff-b92a-bd4c6401427d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.818363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 166/333] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:12 2022] GET /identity/v3/users/5b0fdbb6d50c4c38a0a1407ee9728844 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:12.824657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566d0f7-0b17-4ed3-bc68-919ca475ea97 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.940345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566d0f7-0b17-4ed3-bc68-919ca475ea97 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.976443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c268cd-da34-44ea-8a6a-0aa142d88a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.977158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c268cd-da34-44ea-8a6a-0aa142d88a88 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.977441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c268cd-da34-44ea-8a6a-0aa142d88a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.977714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c268cd-da34-44ea-8a6a-0aa142d88a88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.978501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c268cd-da34-44ea-8a6a-0aa142d88a88 None admin] RBAC: Adding query filter params (role.id=75f020c060fa465d828d5fcb8d48ad60, user.id=5b0fdbb6d50c4c38a0a1407ee9728844, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:12.978842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c268cd-da34-44ea-8a6a-0aa142d88a88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.980300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c268cd-da34-44ea-8a6a-0aa142d88a88 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.995605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 168/334] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 31 11:21:12 2022] GET /identity/v3/role_assignments?user.id=5b0fdbb6d50c4c38a0a1407ee9728844&scope.system=all&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:14.372358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996087b-453a-479a-b0ee-8d7f1c3e65c0 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.372944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996087b-453a-479a-b0ee-8d7f1c3e65c0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.372944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996087b-453a-479a-b0ee-8d7f1c3e65c0 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.375220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 167/335] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:14.381332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e0f4-4b48-4bd2-bc2d-dfa1437d60ab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.381774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e0f4-4b48-4bd2-bc2d-dfa1437d60ab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.381965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e0f4-4b48-4bd2-bc2d-dfa1437d60ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.409625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3ac7e0f4-4b48-4bd2-bc2d-dfa1437d60ab None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:14.410854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ac7e0f4-4b48-4bd2-bc2d-dfa1437d60ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:14.438806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:14.506576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 169/336] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:14.804664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421aa9-6d2b-4a02-b8d1-53cb77daacce None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.805031 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421aa9-6d2b-4a02-b8d1-53cb77daacce None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.805209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421aa9-6d2b-4a02-b8d1-53cb77daacce None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.806838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 168/337] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:14.813146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b95b3-d666-47be-a9c5-879f2edab2d3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.813477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b95b3-d666-47be-a9c5-879f2edab2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.813747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b95b3-d666-47be-a9c5-879f2edab2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.839649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e62b95b3-d666-47be-a9c5-879f2edab2d3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:14.840832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e62b95b3-d666-47be-a9c5-879f2edab2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:14.923907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 170/338] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:15.137360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421aa9-6d2b-4a02-b8d1-53cb77daacce None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.164013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6bb4c-e1ba-43be-8261-39ab6a054de8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.164466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6bb4c-e1ba-43be-8261-39ab6a054de8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.164742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6bb4c-e1ba-43be-8261-39ab6a054de8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.166325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 171/339] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:15.171489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e14601-56e6-4b45-bc88-c9f83cae144c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.172394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e14601-56e6-4b45-bc88-c9f83cae144c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.172672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e14601-56e6-4b45-bc88-c9f83cae144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.204286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e3e14601-56e6-4b45-bc88-c9f83cae144c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:15.206435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e3e14601-56e6-4b45-bc88-c9f83cae144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.232828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:15.315929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421aa9-6d2b-4a02-b8d1-53cb77daacce None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.337636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 172/340] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:15.343057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3202c7-ce7e-468f-b71b-1a9c07eca69c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.343445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3202c7-ce7e-468f-b71b-1a9c07eca69c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.343771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3202c7-ce7e-468f-b71b-1a9c07eca69c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.345684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 173/341] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:15.346729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3202c7-ce7e-468f-b71b-1a9c07eca69c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.354033 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde21c5b-b8c7-4432-9fc0-1bda1008ef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.354871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde21c5b-b8c7-4432-9fc0-1bda1008ef26 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.355355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde21c5b-b8c7-4432-9fc0-1bda1008ef26 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.355791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde21c5b-b8c7-4432-9fc0-1bda1008ef26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.369867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:15.391813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde21c5b-b8c7-4432-9fc0-1bda1008ef26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-bde21c5b-b8c7-4432-9fc0-1bda1008ef26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:15.397670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:15.398543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:15.399372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:15.407064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 169/342] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:15.408536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7df81-385f-4e46-9257-4f5384e50916 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.408988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7df81-385f-4e46-9257-4f5384e50916 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.409441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7df81-385f-4e46-9257-4f5384e50916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.445371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-14c7df81-385f-4e46-9257-4f5384e50916 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:15.446556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-14c7df81-385f-4e46-9257-4f5384e50916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.511362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3202c7-ce7e-468f-b71b-1a9c07eca69c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.564500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 170/343] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:15.565166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7df81-385f-4e46-9257-4f5384e50916 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.579689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10356630-0425-4efa-9a29-a95267e2c4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.580332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10356630-0425-4efa-9a29-a95267e2c4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.580613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10356630-0425-4efa-9a29-a95267e2c4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.580891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10356630-0425-4efa-9a29-a95267e2c4e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.599825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10356630-0425-4efa-9a29-a95267e2c4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-10356630-0425-4efa-9a29-a95267e2c4e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:15.604733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:15.605582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:15.606362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 174/344] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:15.615149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10356630-0425-4efa-9a29-a95267e2c4e0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.668812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:15.722337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7df81-385f-4e46-9257-4f5384e50916 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.756821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:15.768040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98c358-50fe-4291-aa9e-b340d4d96219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.768953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98c358-50fe-4291-aa9e-b340d4d96219 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.769424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98c358-50fe-4291-aa9e-b340d4d96219 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.769901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98c358-50fe-4291-aa9e-b340d4d96219 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.770784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98c358-50fe-4291-aa9e-b340d4d96219 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:15.771276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98c358-50fe-4291-aa9e-b340d4d96219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.772822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98c358-50fe-4291-aa9e-b340d4d96219 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.781603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 171/345] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:15.783730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98c358-50fe-4291-aa9e-b340d4d96219 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.807233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10356630-0425-4efa-9a29-a95267e2c4e0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.866511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578144-c138-4589-b0bb-1a2fff08c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.867375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578144-c138-4589-b0bb-1a2fff08c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.867554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578144-c138-4589-b0bb-1a2fff08c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.867784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578144-c138-4589-b0bb-1a2fff08c5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.868661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4578144-c138-4589-b0bb-1a2fff08c5e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:15.868922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4578144-c138-4589-b0bb-1a2fff08c5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.870310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4578144-c138-4589-b0bb-1a2fff08c5e3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.890722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 175/346] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:15.890722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578144-c138-4589-b0bb-1a2fff08c5e3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.895721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98c358-50fe-4291-aa9e-b340d4d96219 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.908044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:15.934815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7114d-d4c0-48d0-8301-cfb334e56dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.935564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7114d-d4c0-48d0-8301-cfb334e56dfb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.935846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7114d-d4c0-48d0-8301-cfb334e56dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.936120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7114d-d4c0-48d0-8301-cfb334e56dfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.948442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7114d-d4c0-48d0-8301-cfb334e56dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e8b7114d-d4c0-48d0-8301-cfb334e56dfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:15.955638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:15.956538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 172/347] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:15.957771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7114d-d4c0-48d0-8301-cfb334e56dfb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.046755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578144-c138-4589-b0bb-1a2fff08c5e3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.084426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7114d-d4c0-48d0-8301-cfb334e56dfb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.090864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fa1ca-e67d-445b-a853-48747bd7a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.091480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa1ca-e67d-445b-a853-48747bd7a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.091759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa1ca-e67d-445b-a853-48747bd7a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.092031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa1ca-e67d-445b-a853-48747bd7a0b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.095807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:16.133162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6a73e-4d88-4b0d-85f1-8cd9be8697da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.133780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6a73e-4d88-4b0d-85f1-8cd9be8697da None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.134173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6a73e-4d88-4b0d-85f1-8cd9be8697da None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.134450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6a73e-4d88-4b0d-85f1-8cd9be8697da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.186520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:16.188389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fa1ca-e67d-445b-a853-48747bd7a0b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.190891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fa1ca-e67d-445b-a853-48747bd7a0b4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.230987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6a73e-4d88-4b0d-85f1-8cd9be8697da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.232454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6a73e-4d88-4b0d-85f1-8cd9be8697da None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.329608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 176/348] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:16.330396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fa1ca-e67d-445b-a853-48747bd7a0b4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.365697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 173/349] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:16.366619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6a73e-4d88-4b0d-85f1-8cd9be8697da None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.377356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:16.462829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:16.504548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fa1ca-e67d-445b-a853-48747bd7a0b4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.512734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6a73e-4d88-4b0d-85f1-8cd9be8697da None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.561562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03003107-372b-4baf-af22-b2ff02c5f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.563274 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03003107-372b-4baf-af22-b2ff02c5f055 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.563837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03003107-372b-4baf-af22-b2ff02c5f055 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.564390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03003107-372b-4baf-af22-b2ff02c5f055 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.567482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d4090-d48a-4a12-8a1d-f22cd0007052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.568264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d4090-d48a-4a12-8a1d-f22cd0007052 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.568682 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d4090-d48a-4a12-8a1d-f22cd0007052 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.569089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d4090-d48a-4a12-8a1d-f22cd0007052 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.569890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d4090-d48a-4a12-8a1d-f22cd0007052 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:16.570347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d4090-d48a-4a12-8a1d-f22cd0007052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.571875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d4090-d48a-4a12-8a1d-f22cd0007052 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.576975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03003107-372b-4baf-af22-b2ff02c5f055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:16.582638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 174/350] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-03003107-372b-4baf-af22-b2ff02c5f055 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:16.583092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:16.584227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 11:21:16.585038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:16.585622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d4090-d48a-4a12-8a1d-f22cd0007052 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.587721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 177/351] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:16.588824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03003107-372b-4baf-af22-b2ff02c5f055 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.735399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:16.751495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03003107-372b-4baf-af22-b2ff02c5f055 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.769100 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d4090-d48a-4a12-8a1d-f22cd0007052 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.800634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27859efc-388f-4924-b999-190ec1874511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.806550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27859efc-388f-4924-b999-190ec1874511 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.806550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27859efc-388f-4924-b999-190ec1874511 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.806550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27859efc-388f-4924-b999-190ec1874511 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.806550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27859efc-388f-4924-b999-190ec1874511 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.807687 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27859efc-388f-4924-b999-190ec1874511 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.810101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:16.815307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc709342-6980-46eb-b233-e9f7028bea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.816174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 178/352] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:16.820257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc709342-6980-46eb-b233-e9f7028bea8b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.820257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc709342-6980-46eb-b233-e9f7028bea8b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.820257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc709342-6980-46eb-b233-e9f7028bea8b None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.820484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5926fb0-f40e-4d65-8b83-00fb26c0273e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.820484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5926fb0-f40e-4d65-8b83-00fb26c0273e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.820484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5926fb0-f40e-4d65-8b83-00fb26c0273e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.820484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 179/353] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:16.820484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5926fb0-f40e-4d65-8b83-00fb26c0273e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.821633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc709342-6980-46eb-b233-e9f7028bea8b None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.825372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc709342-6980-46eb-b233-e9f7028bea8b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.827893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 175/354] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:16.834070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc709342-6980-46eb-b233-e9f7028bea8b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.956235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5926fb0-f40e-4d65-8b83-00fb26c0273e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.975425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc709342-6980-46eb-b233-e9f7028bea8b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.001935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992aeb7-ba36-463e-a60e-c53dca547033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.002646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992aeb7-ba36-463e-a60e-c53dca547033 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.003122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992aeb7-ba36-463e-a60e-c53dca547033 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.003498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992aeb7-ba36-463e-a60e-c53dca547033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.019953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b2d5f-3587-4221-b736-2c50b5e920b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.020819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b2d5f-3587-4221-b736-2c50b5e920b1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.021097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b2d5f-3587-4221-b736-2c50b5e920b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.021369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b2d5f-3587-4221-b736-2c50b5e920b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.022036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b2d5f-3587-4221-b736-2c50b5e920b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:17.022338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b2d5f-3587-4221-b736-2c50b5e920b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.023839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b2d5f-3587-4221-b736-2c50b5e920b1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.033188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 176/355] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:17.034187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b2d5f-3587-4221-b736-2c50b5e920b1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.042717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:17.086867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992aeb7-ba36-463e-a60e-c53dca547033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.088268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992aeb7-ba36-463e-a60e-c53dca547033 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.109565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:17.153181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b2d5f-3587-4221-b736-2c50b5e920b1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.197369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a580-3091-42fe-92fc-6699f277692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.198014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a580-3091-42fe-92fc-6699f277692c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.198293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a580-3091-42fe-92fc-6699f277692c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.198563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a580-3091-42fe-92fc-6699f277692c None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.204297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 180/356] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:17.205560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2d05-a0eb-48e1-b1bd-6d77b00800c3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.205846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2d05-a0eb-48e1-b1bd-6d77b00800c3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.206120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2d05-a0eb-48e1-b1bd-6d77b00800c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.206550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654a580-3091-42fe-92fc-6699f277692c None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.208046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654a580-3091-42fe-92fc-6699f277692c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.209695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 177/357] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:17.210442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a580-3091-42fe-92fc-6699f277692c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.226048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1b3f2d05-a0eb-48e1-b1bd-6d77b00800c3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:17.227270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1b3f2d05-a0eb-48e1-b1bd-6d77b00800c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:17.298838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:17.313495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 181/358] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:17.314786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0261d-889e-4bb6-9cb1-2e4a0a0cdd45 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.315079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0261d-889e-4bb6-9cb1-2e4a0a0cdd45 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.315355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0261d-889e-4bb6-9cb1-2e4a0a0cdd45 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.316614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 182/359] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:17.317311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0261d-889e-4bb6-9cb1-2e4a0a0cdd45 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.331050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a580-3091-42fe-92fc-6699f277692c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.361965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:17.373697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa49cf7-5dea-4b24-96bf-3379ffdce808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.373697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa49cf7-5dea-4b24-96bf-3379ffdce808 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.373697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa49cf7-5dea-4b24-96bf-3379ffdce808 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.373697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa49cf7-5dea-4b24-96bf-3379ffdce808 None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.375411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa49cf7-5dea-4b24-96bf-3379ffdce808 None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.377303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa49cf7-5dea-4b24-96bf-3379ffdce808 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.379418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 178/360] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:17.384315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa49cf7-5dea-4b24-96bf-3379ffdce808 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.457077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0261d-889e-4bb6-9cb1-2e4a0a0cdd45 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.504478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701b3a0-934e-4fb2-adef-8ee868538788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.505470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b3a0-934e-4fb2-adef-8ee868538788 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.505991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b3a0-934e-4fb2-adef-8ee868538788 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.506441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b3a0-934e-4fb2-adef-8ee868538788 None admin] PATH_INFO: `/v3/users/8b4e0bba82b24c82a473144c71387fba` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.508071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701b3a0-934e-4fb2-adef-8ee868538788 None admin] RBAC: Authorizing `identity:get_user(user_id=8b4e0bba82b24c82a473144c71387fba)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.509740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701b3a0-934e-4fb2-adef-8ee868538788 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.510513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa49cf7-5dea-4b24-96bf-3379ffdce808 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.512315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 183/361] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/users/8b4e0bba82b24c82a473144c71387fba => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:17.513397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701b3a0-934e-4fb2-adef-8ee868538788 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.556969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c96665-c56b-4e17-83e9-96b6415123b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.557973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c96665-c56b-4e17-83e9-96b6415123b8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.558260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c96665-c56b-4e17-83e9-96b6415123b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.558449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c96665-c56b-4e17-83e9-96b6415123b8 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.559667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c96665-c56b-4e17-83e9-96b6415123b8 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.562931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c96665-c56b-4e17-83e9-96b6415123b8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.564923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 179/362] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:17.564923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eead0-7f72-4159-bdeb-160cfc2aa42d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.567521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eead0-7f72-4159-bdeb-160cfc2aa42d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.567521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eead0-7f72-4159-bdeb-160cfc2aa42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.590452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0e5eead0-7f72-4159-bdeb-160cfc2aa42d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:17.591836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0e5eead0-7f72-4159-bdeb-160cfc2aa42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:17.592352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:17.641251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701b3a0-934e-4fb2-adef-8ee868538788 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.662288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:17.677027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 180/363] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:17.678072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eead0-7f72-4159-bdeb-160cfc2aa42d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.684185 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198592ab-06cb-404a-ada5-36b7d41ca376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.684823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198592ab-06cb-404a-ada5-36b7d41ca376 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.685103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198592ab-06cb-404a-ada5-36b7d41ca376 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.685378 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198592ab-06cb-404a-ada5-36b7d41ca376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.686104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198592ab-06cb-404a-ada5-36b7d41ca376 None admin] RBAC: Adding query filter params (group.id=230e991d4587438583e577ffdc71b9e4, role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=8ec546be13a842489477e0212c390b7d) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:17.686410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198592ab-06cb-404a-ada5-36b7d41ca376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.688862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198592ab-06cb-404a-ada5-36b7d41ca376 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.696366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 184/364] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/role_assignments?group.id=230e991d4587438583e577ffdc71b9e4&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:17.697211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198592ab-06cb-404a-ada5-36b7d41ca376 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.789119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eead0-7f72-4159-bdeb-160cfc2aa42d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.830175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d42b9-d9c0-40c6-a336-5e240949487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.830827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d42b9-d9c0-40c6-a336-5e240949487b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.831110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d42b9-d9c0-40c6-a336-5e240949487b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.831386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d42b9-d9c0-40c6-a336-5e240949487b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.832134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d42b9-d9c0-40c6-a336-5e240949487b None admin] RBAC: Adding query filter params (group.id=230e991d4587438583e577ffdc71b9e4, role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=8ec546be13a842489477e0212c390b7d) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:17.832466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d42b9-d9c0-40c6-a336-5e240949487b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.833898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d42b9-d9c0-40c6-a336-5e240949487b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.837930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198592ab-06cb-404a-ada5-36b7d41ca376 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.839935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 181/365] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/role_assignments?group.id=230e991d4587438583e577ffdc71b9e4&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:17.840775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d42b9-d9c0-40c6-a336-5e240949487b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.870064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:17.884685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a15c-0a7b-4e13-8eea-710cd5a45d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.885687 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a15c-0a7b-4e13-8eea-710cd5a45d34 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.886243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a15c-0a7b-4e13-8eea-710cd5a45d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.886739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a15c-0a7b-4e13-8eea-710cd5a45d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.887872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7a15c-0a7b-4e13-8eea-710cd5a45d34 None admin] RBAC: Adding query filter params (role.id=749cda9c1c1448eeba2fa484424d0b15, user.id=8b4e0bba82b24c82a473144c71387fba, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:17.891659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7a15c-0a7b-4e13-8eea-710cd5a45d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.893825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7a15c-0a7b-4e13-8eea-710cd5a45d34 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.907411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:17.914159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 185/366] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/role_assignments?user.id=8b4e0bba82b24c82a473144c71387fba&scope.system=all&role.id=749cda9c1c1448eeba2fa484424d0b15 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:17.915682 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a15c-0a7b-4e13-8eea-710cd5a45d34 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.013449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d42b9-d9c0-40c6-a336-5e240949487b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.072691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0621ed-a1c6-47cc-af10-397398bdc812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.073708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0621ed-a1c6-47cc-af10-397398bdc812 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.074229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0621ed-a1c6-47cc-af10-397398bdc812 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.074719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0621ed-a1c6-47cc-af10-397398bdc812 None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.076235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0621ed-a1c6-47cc-af10-397398bdc812 None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.078520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0621ed-a1c6-47cc-af10-397398bdc812 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.081382 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 182/367] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:18.082391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0621ed-a1c6-47cc-af10-397398bdc812 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.110941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a15c-0a7b-4e13-8eea-710cd5a45d34 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.154186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92aa3-6f7f-4db2-95af-4f2f7ab0c13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.154941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92aa3-6f7f-4db2-95af-4f2f7ab0c13a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.155296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92aa3-6f7f-4db2-95af-4f2f7ab0c13a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.155643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92aa3-6f7f-4db2-95af-4f2f7ab0c13a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.167407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b92aa3-6f7f-4db2-95af-4f2f7ab0c13a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-05b92aa3-6f7f-4db2-95af-4f2f7ab0c13a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:18.173730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:18.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:18.175528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:18.177872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 186/368] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:18.178306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92aa3-6f7f-4db2-95af-4f2f7ab0c13a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.213961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0621ed-a1c6-47cc-af10-397398bdc812 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.229876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:18.243740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:18.259048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf86b59-7415-4770-8166-e74658670c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.260391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf86b59-7415-4770-8166-e74658670c51 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.260811 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf86b59-7415-4770-8166-e74658670c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.261167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf86b59-7415-4770-8166-e74658670c51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.275495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf86b59-7415-4770-8166-e74658670c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3bf86b59-7415-4770-8166-e74658670c51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:18.283082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:18.283981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:18.284757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:18.285362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 183/369] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:21:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:18.286044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf86b59-7415-4770-8166-e74658670c51 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.314508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92aa3-6f7f-4db2-95af-4f2f7ab0c13a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.356362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52d0bf-2bad-4982-8ac8-8b8e32bc70d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.357035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52d0bf-2bad-4982-8ac8-8b8e32bc70d9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.357316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52d0bf-2bad-4982-8ac8-8b8e32bc70d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.357590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52d0bf-2bad-4982-8ac8-8b8e32bc70d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.358328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52d0bf-2bad-4982-8ac8-8b8e32bc70d9 None admin] RBAC: Adding query filter params (group.id=230e991d4587438583e577ffdc71b9e4, role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:18.358658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52d0bf-2bad-4982-8ac8-8b8e32bc70d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.360945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52d0bf-2bad-4982-8ac8-8b8e32bc70d9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.367947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 187/370] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:18 2022] GET /identity/v3/role_assignments?group.id=230e991d4587438583e577ffdc71b9e4&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:18.368542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52d0bf-2bad-4982-8ac8-8b8e32bc70d9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.456133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf86b59-7415-4770-8166-e74658670c51 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.496373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55458a01-e153-41c9-ab5c-77fe75ac9548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.497346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55458a01-e153-41c9-ab5c-77fe75ac9548 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.497847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55458a01-e153-41c9-ab5c-77fe75ac9548 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.498321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55458a01-e153-41c9-ab5c-77fe75ac9548 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.499221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55458a01-e153-41c9-ab5c-77fe75ac9548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:18.499898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55458a01-e153-41c9-ab5c-77fe75ac9548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.501484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55458a01-e153-41c9-ab5c-77fe75ac9548 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.511037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 184/371] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:18.519817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55458a01-e153-41c9-ab5c-77fe75ac9548 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.528278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52d0bf-2bad-4982-8ac8-8b8e32bc70d9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.537333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:18.568978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd2234-af95-4722-a538-337e3b4c737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.569714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd2234-af95-4722-a538-337e3b4c737d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.570005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd2234-af95-4722-a538-337e3b4c737d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.570285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd2234-af95-4722-a538-337e3b4c737d None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.574712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd2234-af95-4722-a538-337e3b4c737d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:18.574712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd2234-af95-4722-a538-337e3b4c737d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.574712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd2234-af95-4722-a538-337e3b4c737d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.582841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 188/372] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:18.588854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd2234-af95-4722-a538-337e3b4c737d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.590193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:18.672841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55458a01-e153-41c9-ab5c-77fe75ac9548 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.701615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd2234-af95-4722-a538-337e3b4c737d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.712299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca716251-b4d8-43d6-a7d7-d33004441740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.713213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca716251-b4d8-43d6-a7d7-d33004441740 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.713690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca716251-b4d8-43d6-a7d7-d33004441740 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.714194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca716251-b4d8-43d6-a7d7-d33004441740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.739803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f0415-4dec-45c1-840c-51a681303be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.740422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f0415-4dec-45c1-840c-51a681303be1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.740706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f0415-4dec-45c1-840c-51a681303be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.740982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f0415-4dec-45c1-840c-51a681303be1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.778241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:18.790994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca716251-b4d8-43d6-a7d7-d33004441740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.792603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca716251-b4d8-43d6-a7d7-d33004441740 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.818163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f0415-4dec-45c1-840c-51a681303be1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.819903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f0415-4dec-45c1-840c-51a681303be1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.841870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:18.901439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 185/373] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:18.907177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca716251-b4d8-43d6-a7d7-d33004441740 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.934870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 189/374] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 11:21:18.937534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f0415-4dec-45c1-840c-51a681303be1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.024872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:19.051091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca716251-b4d8-43d6-a7d7-d33004441740 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.080566 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f0415-4dec-45c1-840c-51a681303be1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.122533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028004-42bc-48b9-9f9f-fd50ce168ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.126063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028004-42bc-48b9-9f9f-fd50ce168ada None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.126364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028004-42bc-48b9-9f9f-fd50ce168ada None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.126615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028004-42bc-48b9-9f9f-fd50ce168ada None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.127853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18028004-42bc-48b9-9f9f-fd50ce168ada None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.129318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18028004-42bc-48b9-9f9f-fd50ce168ada None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.131195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 186/375] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:18 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:19.137290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028004-42bc-48b9-9f9f-fd50ce168ada None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.154849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281cdd6-6f8b-4ecd-b3c4-3e8f5e119f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.156030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281cdd6-6f8b-4ecd-b3c4-3e8f5e119f0b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.156536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281cdd6-6f8b-4ecd-b3c4-3e8f5e119f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.157036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281cdd6-6f8b-4ecd-b3c4-3e8f5e119f0b None admin] PATH_INFO: `/v3/projects/677626bf39d04fc896037ceef125a07a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.160122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281cdd6-6f8b-4ecd-b3c4-3e8f5e119f0b None admin] RBAC: Authorizing `identity:get_project(project_id=677626bf39d04fc896037ceef125a07a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.161586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281cdd6-6f8b-4ecd-b3c4-3e8f5e119f0b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.163441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 190/376] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:18 2022] GET /identity/v3/projects/677626bf39d04fc896037ceef125a07a => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:19.172868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281cdd6-6f8b-4ecd-b3c4-3e8f5e119f0b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.174276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:19.310668 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281cdd6-6f8b-4ecd-b3c4-3e8f5e119f0b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.315293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028004-42bc-48b9-9f9f-fd50ce168ada None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.345130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270e74e-52b9-4bd8-bb82-7a5eedc931b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.345776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270e74e-52b9-4bd8-bb82-7a5eedc931b9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.346309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270e74e-52b9-4bd8-bb82-7a5eedc931b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.346590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270e74e-52b9-4bd8-bb82-7a5eedc931b9 None admin] PATH_INFO: `/v3/groups/5ca8a4101f624243aa006d752f95bc1b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.350434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:19.354500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270e74e-52b9-4bd8-bb82-7a5eedc931b9 None admin] RBAC: Authorizing `identity:get_group(group_id=5ca8a4101f624243aa006d752f95bc1b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.354661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270e74e-52b9-4bd8-bb82-7a5eedc931b9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.356576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 191/377] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:19 2022] GET /identity/v3/groups/5ca8a4101f624243aa006d752f95bc1b => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:19.363613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270e74e-52b9-4bd8-bb82-7a5eedc931b9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.364138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a7f1f-a7b4-405c-97ad-de256a210536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.364984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a7f1f-a7b4-405c-97ad-de256a210536 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.365483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a7f1f-a7b4-405c-97ad-de256a210536 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.365980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a7f1f-a7b4-405c-97ad-de256a210536 None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.367574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a7f1f-a7b4-405c-97ad-de256a210536 None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.369208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a7f1f-a7b4-405c-97ad-de256a210536 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.371097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 187/378] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:19 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:19.377180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a7f1f-a7b4-405c-97ad-de256a210536 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.469243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270e74e-52b9-4bd8-bb82-7a5eedc931b9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.479840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:19.503619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a7f1f-a7b4-405c-97ad-de256a210536 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.508389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0790c8-2481-4c81-a54c-ede7719bc5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.509007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0790c8-2481-4c81-a54c-ede7719bc5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.509294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0790c8-2481-4c81-a54c-ede7719bc5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.509571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0790c8-2481-4c81-a54c-ede7719bc5c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.510310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0790c8-2481-4c81-a54c-ede7719bc5c3 None admin] RBAC: Adding query filter params (group.id=5ca8a4101f624243aa006d752f95bc1b, role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=677626bf39d04fc896037ceef125a07a) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:19.510618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0790c8-2481-4c81-a54c-ede7719bc5c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.512100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0790c8-2481-4c81-a54c-ede7719bc5c3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.518669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 192/379] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:19 2022] GET /identity/v3/role_assignments?group.id=5ca8a4101f624243aa006d752f95bc1b&scope.project.id=677626bf39d04fc896037ceef125a07a&role.id=946af2ff291349299db56e09aacb6b03 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:19.545621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd834312-10bf-4f68-8a6d-deaf4dc84bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.547106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd834312-10bf-4f68-8a6d-deaf4dc84bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.547595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd834312-10bf-4f68-8a6d-deaf4dc84bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.548085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd834312-10bf-4f68-8a6d-deaf4dc84bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.549043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd834312-10bf-4f68-8a6d-deaf4dc84bc5 None admin] RBAC: Adding query filter params (group.id=230e991d4587438583e577ffdc71b9e4, role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:19.549574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd834312-10bf-4f68-8a6d-deaf4dc84bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.551340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd834312-10bf-4f68-8a6d-deaf4dc84bc5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.558734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 188/380] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:19 2022] GET /identity/v3/role_assignments?group.id=230e991d4587438583e577ffdc71b9e4&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:20.493410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd518890-b57f-4e5b-8783-3b3fe8c171ad None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.493930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd518890-b57f-4e5b-8783-3b3fe8c171ad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.493930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd518890-b57f-4e5b-8783-3b3fe8c171ad None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.495340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 193/381] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:20.503324 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32f7a7-b8a4-4703-9320-d57d07f10a7b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.503602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32f7a7-b8a4-4703-9320-d57d07f10a7b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.503885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32f7a7-b8a4-4703-9320-d57d07f10a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.524260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ea32f7a7-b8a4-4703-9320-d57d07f10a7b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:20.525762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ea32f7a7-b8a4-4703-9320-d57d07f10a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:20.609368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 189/382] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:20.766516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722cad7-4a89-45bf-b728-c4b8fa14649e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.766835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722cad7-4a89-45bf-b728-c4b8fa14649e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.767026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722cad7-4a89-45bf-b728-c4b8fa14649e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.768661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 194/383] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:20.773770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c95a-73dd-4bc4-b3b4-0115ae84208c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.774060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c95a-73dd-4bc4-b3b4-0115ae84208c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.774334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c95a-73dd-4bc4-b3b4-0115ae84208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.803726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a133c95a-73dd-4bc4-b3b4-0115ae84208c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:20.804920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a133c95a-73dd-4bc4-b3b4-0115ae84208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:20.889369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 190/384] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:21.005760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e821ca-9386-40f8-87b1-b6e11b81b7a3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.006114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e821ca-9386-40f8-87b1-b6e11b81b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.006322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e821ca-9386-40f8-87b1-b6e11b81b7a3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.007971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 195/385] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:21.013424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9fe98-d032-4f7a-9a11-018341a6e4a0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.013707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9fe98-d032-4f7a-9a11-018341a6e4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.013984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9fe98-d032-4f7a-9a11-018341a6e4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.032956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:21.039374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-04a9fe98-d032-4f7a-9a11-018341a6e4a0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:21.040561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-04a9fe98-d032-4f7a-9a11-018341a6e4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:21.068631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e821ca-9386-40f8-87b1-b6e11b81b7a3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.121107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 191/386] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:21.192228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:21.240313 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e821ca-9386-40f8-87b1-b6e11b81b7a3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.284142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407db46-6bdd-428a-8aeb-3fa0951bc73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.284699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407db46-6bdd-428a-8aeb-3fa0951bc73d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.284975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407db46-6bdd-428a-8aeb-3fa0951bc73d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.285247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407db46-6bdd-428a-8aeb-3fa0951bc73d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.301089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407db46-6bdd-428a-8aeb-3fa0951bc73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b407db46-6bdd-428a-8aeb-3fa0951bc73d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:21.306393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:21.307428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:21.308227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 196/387] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:21.315943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9fe98-d032-4f7a-9a11-018341a6e4a0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.321091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407db46-6bdd-428a-8aeb-3fa0951bc73d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.437790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407db46-6bdd-428a-8aeb-3fa0951bc73d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.467044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:21.485498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24a0d1-de3d-4430-b2e3-d178d599bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.486519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24a0d1-de3d-4430-b2e3-d178d599bd4c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.487026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24a0d1-de3d-4430-b2e3-d178d599bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.487499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24a0d1-de3d-4430-b2e3-d178d599bd4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.503545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24a0d1-de3d-4430-b2e3-d178d599bd4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2e24a0d1-de3d-4430-b2e3-d178d599bd4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:21.512694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:21.513801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:21.514892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:21.518112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 197/388] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:21.523579 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24a0d1-de3d-4430-b2e3-d178d599bd4c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.523702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9fe98-d032-4f7a-9a11-018341a6e4a0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.569384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548f40d-d6fc-4853-b7f1-e0c6f6e6b420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.570765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548f40d-d6fc-4853-b7f1-e0c6f6e6b420 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.571483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548f40d-d6fc-4853-b7f1-e0c6f6e6b420 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.571939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548f40d-d6fc-4853-b7f1-e0c6f6e6b420 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.572952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548f40d-d6fc-4853-b7f1-e0c6f6e6b420 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:21.573493 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548f40d-d6fc-4853-b7f1-e0c6f6e6b420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:21.575728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548f40d-d6fc-4853-b7f1-e0c6f6e6b420 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:21.578880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:21.587917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 192/389] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:21.593491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548f40d-d6fc-4853-b7f1-e0c6f6e6b420 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.640706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24a0d1-de3d-4430-b2e3-d178d599bd4c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.678141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf936b6-3e0b-4ab3-8a16-581cbb830ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.678997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf936b6-3e0b-4ab3-8a16-581cbb830ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.679353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf936b6-3e0b-4ab3-8a16-581cbb830ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.679693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf936b6-3e0b-4ab3-8a16-581cbb830ed0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.691504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf936b6-3e0b-4ab3-8a16-581cbb830ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-caf936b6-3e0b-4ab3-8a16-581cbb830ed0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:21.697527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:21.698418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:21.699255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:21.704412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 198/390] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:21.705459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf936b6-3e0b-4ab3-8a16-581cbb830ed0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.724506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548f40d-d6fc-4853-b7f1-e0c6f6e6b420 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.758456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:21.771211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846289b7-b717-42ea-bb72-afa04d066905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.772220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846289b7-b717-42ea-bb72-afa04d066905 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.772982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846289b7-b717-42ea-bb72-afa04d066905 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.773408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846289b7-b717-42ea-bb72-afa04d066905 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.774565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846289b7-b717-42ea-bb72-afa04d066905 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:21.775032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846289b7-b717-42ea-bb72-afa04d066905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:21.777290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846289b7-b717-42ea-bb72-afa04d066905 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:21.789626 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 193/391] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:21.790650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846289b7-b717-42ea-bb72-afa04d066905 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.827490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf936b6-3e0b-4ab3-8a16-581cbb830ed0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.865165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:21.867567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af24dd-7c7d-4c88-87d6-286f10fd40c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.868908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af24dd-7c7d-4c88-87d6-286f10fd40c7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.869214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af24dd-7c7d-4c88-87d6-286f10fd40c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.869569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af24dd-7c7d-4c88-87d6-286f10fd40c7 None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.870723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af24dd-7c7d-4c88-87d6-286f10fd40c7 None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:21.872221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af24dd-7c7d-4c88-87d6-286f10fd40c7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:21.874015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 199/392] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:21.874015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af24dd-7c7d-4c88-87d6-286f10fd40c7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.913448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846289b7-b717-42ea-bb72-afa04d066905 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.948552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e10cf6-c714-4956-ad4b-6d73eb48c99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.949156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e10cf6-c714-4956-ad4b-6d73eb48c99f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.949437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e10cf6-c714-4956-ad4b-6d73eb48c99f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.949712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e10cf6-c714-4956-ad4b-6d73eb48c99f None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.950372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e10cf6-c714-4956-ad4b-6d73eb48c99f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:21.950672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e10cf6-c714-4956-ad4b-6d73eb48c99f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:21.952069 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e10cf6-c714-4956-ad4b-6d73eb48c99f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:21.959926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 194/393] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:21.961073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfa092-ee82-4f92-9ebd-04f435e4ef68 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.961361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfa092-ee82-4f92-9ebd-04f435e4ef68 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.961639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfa092-ee82-4f92-9ebd-04f435e4ef68 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.963041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 195/394] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:21.963561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfa092-ee82-4f92-9ebd-04f435e4ef68 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.988718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af24dd-7c7d-4c88-87d6-286f10fd40c7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.002040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:22.022775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014fe3b-82f7-4fc3-871d-1d6849c6eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.023465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014fe3b-82f7-4fc3-871d-1d6849c6eb0c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.023747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014fe3b-82f7-4fc3-871d-1d6849c6eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.024018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014fe3b-82f7-4fc3-871d-1d6849c6eb0c None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.025131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014fe3b-82f7-4fc3-871d-1d6849c6eb0c None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.026569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014fe3b-82f7-4fc3-871d-1d6849c6eb0c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.028179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 200/395] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:22.029349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6390875-f021-48a6-8fbc-847542691586 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.029623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6390875-f021-48a6-8fbc-847542691586 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.029892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6390875-f021-48a6-8fbc-847542691586 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.031628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 201/396] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:22.032318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6390875-f021-48a6-8fbc-847542691586 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.079832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfa092-ee82-4f92-9ebd-04f435e4ef68 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.103741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:22.116605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55e95-1df9-4049-a826-16ec397d32d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.117237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55e95-1df9-4049-a826-16ec397d32d4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.117500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55e95-1df9-4049-a826-16ec397d32d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.117771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55e95-1df9-4049-a826-16ec397d32d4 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.118912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d55e95-1df9-4049-a826-16ec397d32d4 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.120392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d55e95-1df9-4049-a826-16ec397d32d4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.122066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 196/397] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:22.123261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069ca4-5ff0-436e-b598-73a46856c69e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.123542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069ca4-5ff0-436e-b598-73a46856c69e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.123810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069ca4-5ff0-436e-b598-73a46856c69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.140091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6390875-f021-48a6-8fbc-847542691586 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.141318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a5069ca4-5ff0-436e-b598-73a46856c69e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:22.142483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a5069ca4-5ff0-436e-b598-73a46856c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.178113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1176ad-845b-4a3c-96c3-c7ac472fb30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.178113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1176ad-845b-4a3c-96c3-c7ac472fb30d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.178113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1176ad-845b-4a3c-96c3-c7ac472fb30d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.178113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1176ad-845b-4a3c-96c3-c7ac472fb30d None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.178845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1176ad-845b-4a3c-96c3-c7ac472fb30d None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.178845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1176ad-845b-4a3c-96c3-c7ac472fb30d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.179826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 202/398] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:22 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:22.180583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1176ad-845b-4a3c-96c3-c7ac472fb30d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.216885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 197/399] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:22.219573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566148a7-8c50-4f15-b655-d07223fa01d0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.220038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566148a7-8c50-4f15-b655-d07223fa01d0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.220486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566148a7-8c50-4f15-b655-d07223fa01d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.238770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:22.244351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-566148a7-8c50-4f15-b655-d07223fa01d0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:22.245816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-566148a7-8c50-4f15-b655-d07223fa01d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.299334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1176ad-845b-4a3c-96c3-c7ac472fb30d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.334798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 198/400] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:22.334798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566148a7-8c50-4f15-b655-d07223fa01d0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.342313 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff557b0-065c-4f86-950c-29d25ab4da20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.343483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff557b0-065c-4f86-950c-29d25ab4da20 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.343998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff557b0-065c-4f86-950c-29d25ab4da20 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.344469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff557b0-065c-4f86-950c-29d25ab4da20 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.345699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff557b0-065c-4f86-950c-29d25ab4da20 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.347829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff557b0-065c-4f86-950c-29d25ab4da20 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.354522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 203/401] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:22 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:22.354522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff557b0-065c-4f86-950c-29d25ab4da20 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.399775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:22.465049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566148a7-8c50-4f15-b655-d07223fa01d0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.495862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff557b0-065c-4f86-950c-29d25ab4da20 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.516150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:22.517189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183a751-9428-4310-93ef-e4f97c3c215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.518598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183a751-9428-4310-93ef-e4f97c3c215e None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.518985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183a751-9428-4310-93ef-e4f97c3c215e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.519383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183a751-9428-4310-93ef-e4f97c3c215e None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d/groups/230e991d4587438583e577ffdc71b9e4/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.522032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183a751-9428-4310-93ef-e4f97c3c215e None admin] RBAC: Authorizing `identity:create_grant(project_id=8ec546be13a842489477e0212c390b7d, group_id=230e991d4587438583e577ffdc71b9e4, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.525170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183a751-9428-4310-93ef-e4f97c3c215e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.544314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb45757-2501-48a3-a151-f0fd283e13fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.545027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb45757-2501-48a3-a151-f0fd283e13fb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.545725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb45757-2501-48a3-a151-f0fd283e13fb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.545993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb45757-2501-48a3-a151-f0fd283e13fb None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.547001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 199/402] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 31 11:21:22 2022] PUT /identity/v3/projects/8ec546be13a842489477e0212c390b7d/groups/230e991d4587438583e577ffdc71b9e4/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:22.547287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb45757-2501-48a3-a151-f0fd283e13fb None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.548565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183a751-9428-4310-93ef-e4f97c3c215e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.553076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb45757-2501-48a3-a151-f0fd283e13fb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.559590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 204/403] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:22 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:22.559590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb45757-2501-48a3-a151-f0fd283e13fb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.696886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb45757-2501-48a3-a151-f0fd283e13fb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.711895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183a751-9428-4310-93ef-e4f97c3c215e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.727314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:22.744211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf9988-cc3d-4002-a76d-c002ba40de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.744850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf9988-cc3d-4002-a76d-c002ba40de89 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.745130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf9988-cc3d-4002-a76d-c002ba40de89 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.745421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf9988-cc3d-4002-a76d-c002ba40de89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.756170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17c63f-b69c-4049-a2ce-479072555a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.756833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17c63f-b69c-4049-a2ce-479072555a17 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.757100 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17c63f-b69c-4049-a2ce-479072555a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.757372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17c63f-b69c-4049-a2ce-479072555a17 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/groups/230e991d4587438583e577ffdc71b9e4/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.758279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf9988-cc3d-4002-a76d-c002ba40de89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:22.759317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17c63f-b69c-4049-a2ce-479072555a17 None admin] RBAC: Authorizing `identity:create_grant(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c, group_id=230e991d4587438583e577ffdc71b9e4, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.760748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17c63f-b69c-4049-a2ce-479072555a17 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b3cf9988-cc3d-4002-a76d-c002ba40de89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:22.764264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:22.765915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:22.766824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:22.768166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 205/404] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:21:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:22.769222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf9988-cc3d-4002-a76d-c002ba40de89 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.784980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 200/405] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 31 11:21:22 2022] PUT /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/groups/230e991d4587438583e577ffdc71b9e4/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:22.785815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17c63f-b69c-4049-a2ce-479072555a17 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.856474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:22.943653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf9988-cc3d-4002-a76d-c002ba40de89 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.965147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17c63f-b69c-4049-a2ce-479072555a17 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.990927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeae009-4aea-4e5c-a692-cf067a23c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.991595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeae009-4aea-4e5c-a692-cf067a23c9c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.991875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeae009-4aea-4e5c-a692-cf067a23c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.992144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeae009-4aea-4e5c-a692-cf067a23c9c6 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d/groups/230e991d4587438583e577ffdc71b9e4/roles/d48e46bf2b814100a25f94d5cdffecfd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.994499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeae009-4aea-4e5c-a692-cf067a23c9c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ec546be13a842489477e0212c390b7d, group_id=230e991d4587438583e577ffdc71b9e4, role_id=d48e46bf2b814100a25f94d5cdffecfd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.996006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeae009-4aea-4e5c-a692-cf067a23c9c6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.023121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 206/406] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 31 11:21:22 2022] PUT /identity/v3/projects/8ec546be13a842489477e0212c390b7d/groups/230e991d4587438583e577ffdc71b9e4/roles/d48e46bf2b814100a25f94d5cdffecfd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:23.023121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeae009-4aea-4e5c-a692-cf067a23c9c6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.037080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80df0e-5926-48c8-aab3-895912608d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.037777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80df0e-5926-48c8-aab3-895912608d90 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.038050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80df0e-5926-48c8-aab3-895912608d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.038316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80df0e-5926-48c8-aab3-895912608d90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.057346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80df0e-5926-48c8-aab3-895912608d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ba80df0e-5926-48c8-aab3-895912608d90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:23.063494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:23.064562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:23.065362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:23.066898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 201/407] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:21:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:23.071172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80df0e-5926-48c8-aab3-895912608d90 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.111065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:23.211569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80df0e-5926-48c8-aab3-895912608d90 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.255482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeae009-4aea-4e5c-a692-cf067a23c9c6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.259302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:23.260209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbcf0f-6c02-4804-9c39-e184e6f1710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.260831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbcf0f-6c02-4804-9c39-e184e6f1710e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.261146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbcf0f-6c02-4804-9c39-e184e6f1710e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.261418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbcf0f-6c02-4804-9c39-e184e6f1710e None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.262250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbcf0f-6c02-4804-9c39-e184e6f1710e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:23.262556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbcf0f-6c02-4804-9c39-e184e6f1710e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.264103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbcf0f-6c02-4804-9c39-e184e6f1710e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.283634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 202/408] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:23.289412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbcf0f-6c02-4804-9c39-e184e6f1710e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.310802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7e2c5-6cb1-47cc-a295-6ebb66657af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.311425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7e2c5-6cb1-47cc-a295-6ebb66657af8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.312317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7e2c5-6cb1-47cc-a295-6ebb66657af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.312658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7e2c5-6cb1-47cc-a295-6ebb66657af8 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.313343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7e2c5-6cb1-47cc-a295-6ebb66657af8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:23.313649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7e2c5-6cb1-47cc-a295-6ebb66657af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.315182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7e2c5-6cb1-47cc-a295-6ebb66657af8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.327707 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 207/409] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:23.336775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7e2c5-6cb1-47cc-a295-6ebb66657af8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.395806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:23.406395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbcf0f-6c02-4804-9c39-e184e6f1710e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.442701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc74c20-1146-4569-b0f5-07a90c44bc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.443564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc74c20-1146-4569-b0f5-07a90c44bc31 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.444001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc74c20-1146-4569-b0f5-07a90c44bc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.444417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc74c20-1146-4569-b0f5-07a90c44bc31 None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.445691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc74c20-1146-4569-b0f5-07a90c44bc31 None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.447303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc74c20-1146-4569-b0f5-07a90c44bc31 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.449327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 203/410] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:23.455356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc74c20-1146-4569-b0f5-07a90c44bc31 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.560467 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc74c20-1146-4569-b0f5-07a90c44bc31 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.596881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70e18-1c59-4311-913d-23c80770275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.597513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70e18-1c59-4311-913d-23c80770275b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.597788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70e18-1c59-4311-913d-23c80770275b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.598060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70e18-1c59-4311-913d-23c80770275b None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.599218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70e18-1c59-4311-913d-23c80770275b None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.600529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7e2c5-6cb1-47cc-a295-6ebb66657af8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.600974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70e18-1c59-4311-913d-23c80770275b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.602499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 204/411] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:23.607875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70e18-1c59-4311-913d-23c80770275b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.637816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:23.691277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3332ae-04dc-44bc-ab26-831c4d3eb34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.691912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3332ae-04dc-44bc-ab26-831c4d3eb34f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.692191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3332ae-04dc-44bc-ab26-831c4d3eb34f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.692465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3332ae-04dc-44bc-ab26-831c4d3eb34f None admin] PATH_INFO: `/v3/groups/5ca8a4101f624243aa006d752f95bc1b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.694626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3332ae-04dc-44bc-ab26-831c4d3eb34f None admin] RBAC: Authorizing `identity:get_group(group_id=5ca8a4101f624243aa006d752f95bc1b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.696360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3332ae-04dc-44bc-ab26-831c4d3eb34f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.704635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 208/412] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/groups/5ca8a4101f624243aa006d752f95bc1b => generated 229 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:23.706413 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3332ae-04dc-44bc-ab26-831c4d3eb34f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.763803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70e18-1c59-4311-913d-23c80770275b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.764823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:23.830077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3332ae-04dc-44bc-ab26-831c4d3eb34f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.861187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7947e6-86d6-4801-b496-87b39d9c540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.861862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7947e6-86d6-4801-b496-87b39d9c540a None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.862248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7947e6-86d6-4801-b496-87b39d9c540a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.862524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7947e6-86d6-4801-b496-87b39d9c540a None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/groups/230e991d4587438583e577ffdc71b9e4/roles/d48e46bf2b814100a25f94d5cdffecfd` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.865035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c07ea-0300-4c8f-bc9e-edb3f247f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.865664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c07ea-0300-4c8f-bc9e-edb3f247f772 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.865945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c07ea-0300-4c8f-bc9e-edb3f247f772 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.866212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c07ea-0300-4c8f-bc9e-edb3f247f772 None admin] PATH_INFO: `/v3/projects/677626bf39d04fc896037ceef125a07a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.867397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c07ea-0300-4c8f-bc9e-edb3f247f772 None admin] RBAC: Authorizing `identity:get_project(project_id=677626bf39d04fc896037ceef125a07a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.867903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7947e6-86d6-4801-b496-87b39d9c540a None admin] RBAC: Authorizing `identity:create_grant(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c, group_id=230e991d4587438583e577ffdc71b9e4, role_id=d48e46bf2b814100a25f94d5cdffecfd)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.868860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c07ea-0300-4c8f-bc9e-edb3f247f772 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.869342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7947e6-86d6-4801-b496-87b39d9c540a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.874810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 209/413] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/projects/677626bf39d04fc896037ceef125a07a => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:23.876529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c07ea-0300-4c8f-bc9e-edb3f247f772 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.898796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 205/414] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 31 11:21:23 2022] PUT /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c/groups/230e991d4587438583e577ffdc71b9e4/roles/d48e46bf2b814100a25f94d5cdffecfd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:24.008587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c07ea-0300-4c8f-bc9e-edb3f247f772 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:24.010191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:24.051561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70da56-3bff-4222-8612-4b647b067a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:24.052317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70da56-3bff-4222-8612-4b647b067a65 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:24.052600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70da56-3bff-4222-8612-4b647b067a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:24.052872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70da56-3bff-4222-8612-4b647b067a65 None admin] PATH_INFO: `/v3/projects/677626bf39d04fc896037ceef125a07a/groups/5ca8a4101f624243aa006d752f95bc1b/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:24.057172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70da56-3bff-4222-8612-4b647b067a65 None admin] RBAC: Authorizing `identity:create_grant(project_id=677626bf39d04fc896037ceef125a07a, group_id=5ca8a4101f624243aa006d752f95bc1b, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:24.058717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70da56-3bff-4222-8612-4b647b067a65 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:24.074209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 210/415] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 31 11:21:23 2022] PUT /identity/v3/projects/677626bf39d04fc896037ceef125a07a/groups/5ca8a4101f624243aa006d752f95bc1b/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:24.873054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7c4b-0cdd-4c67-a40c-e19284a3837e None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:24.873595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7c4b-0cdd-4c67-a40c-e19284a3837e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:24.873595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7c4b-0cdd-4c67-a40c-e19284a3837e None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:24.876341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 206/416] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:24.881504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd56c-2915-4c14-95cc-1e00bdbfd740 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:24.881961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd56c-2915-4c14-95cc-1e00bdbfd740 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:24.882047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd56c-2915-4c14-95cc-1e00bdbfd740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:24.902546 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4effd56c-2915-4c14-95cc-1e00bdbfd740 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:24.903768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4effd56c-2915-4c14-95cc-1e00bdbfd740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:25.003563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 211/417] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:25.197555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f83365-a550-41ec-8ac1-6d1d43db022c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.197874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f83365-a550-41ec-8ac1-6d1d43db022c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.198097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f83365-a550-41ec-8ac1-6d1d43db022c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.199637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 207/418] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:25.205499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6e0a0-505d-40e3-aed7-8946b5b3fbaa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.205784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6e0a0-505d-40e3-aed7-8946b5b3fbaa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.206058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6e0a0-505d-40e3-aed7-8946b5b3fbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.227778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a3d6e0a0-505d-40e3-aed7-8946b5b3fbaa None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:25.228948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a3d6e0a0-505d-40e3-aed7-8946b5b3fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:25.324464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 212/419] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:25.328578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebd31f-bbdb-4450-ae00-dc729d003887 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.329084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebd31f-bbdb-4450-ae00-dc729d003887 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.329556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebd31f-bbdb-4450-ae00-dc729d003887 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.332344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 208/420] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:25.336813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d0b7-44a9-46ed-baa1-80ddf40bf1bd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.337091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d0b7-44a9-46ed-baa1-80ddf40bf1bd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.337361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d0b7-44a9-46ed-baa1-80ddf40bf1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.356177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d8a5d0b7-44a9-46ed-baa1-80ddf40bf1bd None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:25.357339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d8a5d0b7-44a9-46ed-baa1-80ddf40bf1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:25.375688 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:25.424706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebd31f-bbdb-4450-ae00-dc729d003887 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.449532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 213/421] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:25.583118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:25.600367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebd31f-bbdb-4450-ae00-dc729d003887 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.639367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17336f-0964-4523-a8e8-56d8a58c9398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.640131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17336f-0964-4523-a8e8-56d8a58c9398 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.640630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17336f-0964-4523-a8e8-56d8a58c9398 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.640816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17336f-0964-4523-a8e8-56d8a58c9398 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.659749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17336f-0964-4523-a8e8-56d8a58c9398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-5d17336f-0964-4523-a8e8-56d8a58c9398 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:25.665103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:25.665968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:25.666783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 209/422] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:25.679465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d0b7-44a9-46ed-baa1-80ddf40bf1bd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.712648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17336f-0964-4523-a8e8-56d8a58c9398 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.809186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d0b7-44a9-46ed-baa1-80ddf40bf1bd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.850456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7361288-8f8e-4391-9b87-ecb302e266ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.851896 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361288-8f8e-4391-9b87-ecb302e266ef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.852373 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361288-8f8e-4391-9b87-ecb302e266ef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.852850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361288-8f8e-4391-9b87-ecb302e266ef None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.853705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7361288-8f8e-4391-9b87-ecb302e266ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:25.854280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7361288-8f8e-4391-9b87-ecb302e266ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.856011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7361288-8f8e-4391-9b87-ecb302e266ef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.865854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 214/423] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:25.866986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7361288-8f8e-4391-9b87-ecb302e266ef None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.879262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17336f-0964-4523-a8e8-56d8a58c9398 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.893475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:25.921027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dc779-52a9-4a1f-a5a2-bffa8101beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.921832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dc779-52a9-4a1f-a5a2-bffa8101beb3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.922058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dc779-52a9-4a1f-a5a2-bffa8101beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.922326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dc779-52a9-4a1f-a5a2-bffa8101beb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.933124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dc779-52a9-4a1f-a5a2-bffa8101beb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-d69dc779-52a9-4a1f-a5a2-bffa8101beb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:25.939364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:25.940288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:25.941155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 210/424] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:25.941806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dc779-52a9-4a1f-a5a2-bffa8101beb3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.954008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:25.999026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7361288-8f8e-4391-9b87-ecb302e266ef None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.040175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d19fe-9490-4431-83d1-903cabfc514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.041172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d19fe-9490-4431-83d1-903cabfc514a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.041730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d19fe-9490-4431-83d1-903cabfc514a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.042211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d19fe-9490-4431-83d1-903cabfc514a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.048379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dc779-52a9-4a1f-a5a2-bffa8101beb3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.054933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d19fe-9490-4431-83d1-903cabfc514a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-711d19fe-9490-4431-83d1-903cabfc514a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:26.060779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:26.062235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:26.063663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:26.066053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 215/425] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:26.071730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d19fe-9490-4431-83d1-903cabfc514a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.085122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e3f91-2885-411b-89f0-1c2655daa16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.085801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3f91-2885-411b-89f0-1c2655daa16c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.086079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3f91-2885-411b-89f0-1c2655daa16c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.086353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3f91-2885-411b-89f0-1c2655daa16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.158619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e3f91-2885-411b-89f0-1c2655daa16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.160065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e3f91-2885-411b-89f0-1c2655daa16c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.161180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:26.172473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:26.195514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d19fe-9490-4431-83d1-903cabfc514a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.235490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f3a92-967f-4365-b7de-d6d27ca2e389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.236443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f3a92-967f-4365-b7de-d6d27ca2e389 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.236942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f3a92-967f-4365-b7de-d6d27ca2e389 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.237427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f3a92-967f-4365-b7de-d6d27ca2e389 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.238283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f3a92-967f-4365-b7de-d6d27ca2e389 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:26.238823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f3a92-967f-4365-b7de-d6d27ca2e389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.240504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f3a92-967f-4365-b7de-d6d27ca2e389 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.251027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 216/426] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:26.252290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f3a92-967f-4365-b7de-d6d27ca2e389 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.268709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 211/427] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:26.269684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e3f91-2885-411b-89f0-1c2655daa16c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.366590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f3a92-967f-4365-b7de-d6d27ca2e389 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.376030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e3f91-2885-411b-89f0-1c2655daa16c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.386579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:26.407236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367ea75-a5c7-4eb8-b217-f290acd73a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.407842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367ea75-a5c7-4eb8-b217-f290acd73a3b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.408123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367ea75-a5c7-4eb8-b217-f290acd73a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.408399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367ea75-a5c7-4eb8-b217-f290acd73a3b None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.409287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367ea75-a5c7-4eb8-b217-f290acd73a3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:26.409389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367ea75-a5c7-4eb8-b217-f290acd73a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.410741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367ea75-a5c7-4eb8-b217-f290acd73a3b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.413245 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:26.414125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cb784-2c4a-47b7-861d-c4552948a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.414925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cb784-2c4a-47b7-861d-c4552948a6fd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.415287 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cb784-2c4a-47b7-861d-c4552948a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.415791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cb784-2c4a-47b7-861d-c4552948a6fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.421140 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 217/428] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:26.422699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367ea75-a5c7-4eb8-b217-f290acd73a3b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.497046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cb784-2c4a-47b7-861d-c4552948a6fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.498507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cb784-2c4a-47b7-861d-c4552948a6fd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.538401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367ea75-a5c7-4eb8-b217-f290acd73a3b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.572101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e553a-e9e4-41b2-8dd7-d689da25e197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.572722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e553a-e9e4-41b2-8dd7-d689da25e197 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.573028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e553a-e9e4-41b2-8dd7-d689da25e197 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.573304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e553a-e9e4-41b2-8dd7-d689da25e197 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.574434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e553a-e9e4-41b2-8dd7-d689da25e197 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.575960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e553a-e9e4-41b2-8dd7-d689da25e197 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.578264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 218/429] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:26.579412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239514f4-fcdd-421c-9179-e330c48fba6a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.579693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239514f4-fcdd-421c-9179-e330c48fba6a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.579967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239514f4-fcdd-421c-9179-e330c48fba6a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.581174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 219/430] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:26.581872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239514f4-fcdd-421c-9179-e330c48fba6a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.601730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 212/431] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:26.603114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d0c3-863c-4ab7-93db-649509c355de None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.603398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d0c3-863c-4ab7-93db-649509c355de None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.603665 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d0c3-863c-4ab7-93db-649509c355de None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.607121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 213/432] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:26.607121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d0c3-863c-4ab7-93db-649509c355de None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.616079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:26.652191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:26.688927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239514f4-fcdd-421c-9179-e330c48fba6a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.708425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d0c3-863c-4ab7-93db-649509c355de None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.723192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256ad59-9dbb-4174-b9a8-199c5b1779b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.723799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ad59-9dbb-4174-b9a8-199c5b1779b1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.724079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ad59-9dbb-4174-b9a8-199c5b1779b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.724352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ad59-9dbb-4174-b9a8-199c5b1779b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.745259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cc2c2-6d48-44fe-8121-f89039a303bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.745880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc2c2-6d48-44fe-8121-f89039a303bc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.746156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc2c2-6d48-44fe-8121-f89039a303bc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.746422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc2c2-6d48-44fe-8121-f89039a303bc None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.747555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cc2c2-6d48-44fe-8121-f89039a303bc None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.748970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cc2c2-6d48-44fe-8121-f89039a303bc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.751196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 214/433] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:26.752288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e84420-d6f9-42a2-8fcf-de2a0adb2408 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.752563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e84420-d6f9-42a2-8fcf-de2a0adb2408 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.752837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e84420-d6f9-42a2-8fcf-de2a0adb2408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.772026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-02e84420-d6f9-42a2-8fcf-de2a0adb2408 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:26.773208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-02e84420-d6f9-42a2-8fcf-de2a0adb2408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.800020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256ad59-9dbb-4174-b9a8-199c5b1779b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.801495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256ad59-9dbb-4174-b9a8-199c5b1779b1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.838932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 215/434] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:26.842999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e84420-d6f9-42a2-8fcf-de2a0adb2408 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.851445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:26.867631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:26.907131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 220/435] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:26.908391 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd1dac-2c79-4626-adf7-df169f83459a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.908673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd1dac-2c79-4626-adf7-df169f83459a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.908942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd1dac-2c79-4626-adf7-df169f83459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.929635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-69fd1dac-2c79-4626-adf7-df169f83459a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:26.930866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-69fd1dac-2c79-4626-adf7-df169f83459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.950282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e84420-d6f9-42a2-8fcf-de2a0adb2408 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.987055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b144ff-aa3e-4d71-b290-6dfe8e5c8980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.987836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b144ff-aa3e-4d71-b290-6dfe8e5c8980 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.988114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b144ff-aa3e-4d71-b290-6dfe8e5c8980 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.988438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b144ff-aa3e-4d71-b290-6dfe8e5c8980 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.989584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b144ff-aa3e-4d71-b290-6dfe8e5c8980 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.991035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b144ff-aa3e-4d71-b290-6dfe8e5c8980 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.997129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 216/436] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:26.997129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b144ff-aa3e-4d71-b290-6dfe8e5c8980 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.022949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 221/437] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:27.023963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd1dac-2c79-4626-adf7-df169f83459a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.080993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:27.117113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b144ff-aa3e-4d71-b290-6dfe8e5c8980 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.136544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:27.144049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd1dac-2c79-4626-adf7-df169f83459a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.159926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73995606-b215-4d09-ada7-b42465c69242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.160446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73995606-b215-4d09-ada7-b42465c69242 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.160719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73995606-b215-4d09-ada7-b42465c69242 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.160985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73995606-b215-4d09-ada7-b42465c69242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.161704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73995606-b215-4d09-ada7-b42465c69242 None admin] RBAC: Adding query filter params (group.id=230e991d4587438583e577ffdc71b9e4, role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=8ec546be13a842489477e0212c390b7d) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:27.162006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73995606-b215-4d09-ada7-b42465c69242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.163505 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73995606-b215-4d09-ada7-b42465c69242 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.178724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 217/438] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/role_assignments?group.id=230e991d4587438583e577ffdc71b9e4&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:27.178724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73995606-b215-4d09-ada7-b42465c69242 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.195365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e53f3f-cab8-4973-8e7f-83815c83fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.195787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e53f3f-cab8-4973-8e7f-83815c83fe54 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.196003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e53f3f-cab8-4973-8e7f-83815c83fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.196276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e53f3f-cab8-4973-8e7f-83815c83fe54 None admin] PATH_INFO: `/v3/projects/8ec546be13a842489477e0212c390b7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.197506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e53f3f-cab8-4973-8e7f-83815c83fe54 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec546be13a842489477e0212c390b7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.199020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e53f3f-cab8-4973-8e7f-83815c83fe54 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.200984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 222/439] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/projects/8ec546be13a842489477e0212c390b7d => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:27.201864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e53f3f-cab8-4973-8e7f-83815c83fe54 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.329557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73995606-b215-4d09-ada7-b42465c69242 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.333602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e53f3f-cab8-4973-8e7f-83815c83fe54 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.368944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2eb6-d370-433e-9ef8-f974132ebc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.369162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2eb6-d370-433e-9ef8-f974132ebc39 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.369259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2eb6-d370-433e-9ef8-f974132ebc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.369513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2eb6-d370-433e-9ef8-f974132ebc39 None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.370621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd2eb6-d370-433e-9ef8-f974132ebc39 None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.372788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd2eb6-d370-433e-9ef8-f974132ebc39 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.373967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 218/440] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:27.376082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2eb6-d370-433e-9ef8-f974132ebc39 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.379079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc85ad-9050-4c2e-a8d3-7d02d4df157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.380304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc85ad-9050-4c2e-a8d3-7d02d4df157d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.380587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc85ad-9050-4c2e-a8d3-7d02d4df157d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.380852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc85ad-9050-4c2e-a8d3-7d02d4df157d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.384857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:27.394826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc85ad-9050-4c2e-a8d3-7d02d4df157d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7bfc85ad-9050-4c2e-a8d3-7d02d4df157d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:27.399980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:27.401030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 223/441] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:27.402184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc85ad-9050-4c2e-a8d3-7d02d4df157d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.432836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:27.499777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2eb6-d370-433e-9ef8-f974132ebc39 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.523848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc85ad-9050-4c2e-a8d3-7d02d4df157d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.539666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b84ce-9747-4a29-880d-1a902455dae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.540441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b84ce-9747-4a29-880d-1a902455dae3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.540821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b84ce-9747-4a29-880d-1a902455dae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.541193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b84ce-9747-4a29-880d-1a902455dae3 None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.543429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b84ce-9747-4a29-880d-1a902455dae3 None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.544936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b84ce-9747-4a29-880d-1a902455dae3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.547181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 219/442] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:27.547944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b84ce-9747-4a29-880d-1a902455dae3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.578329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55649632-2cd7-467b-ad82-7444e2b10b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.578825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649632-2cd7-467b-ad82-7444e2b10b7e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.579107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649632-2cd7-467b-ad82-7444e2b10b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.579381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649632-2cd7-467b-ad82-7444e2b10b7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.591802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55649632-2cd7-467b-ad82-7444e2b10b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-55649632-2cd7-467b-ad82-7444e2b10b7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:27.597777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:27.598839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:27.599685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 224/443] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:27.600339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55649632-2cd7-467b-ad82-7444e2b10b7e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.629626 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:27.654630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b84ce-9747-4a29-880d-1a902455dae3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.684388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:27.693344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240dbec-87cd-48e6-a0cb-0c7e9bba822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.693951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240dbec-87cd-48e6-a0cb-0c7e9bba822a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.694233 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240dbec-87cd-48e6-a0cb-0c7e9bba822a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.694504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240dbec-87cd-48e6-a0cb-0c7e9bba822a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.695272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240dbec-87cd-48e6-a0cb-0c7e9bba822a None admin] RBAC: Adding query filter params (group.id=230e991d4587438583e577ffdc71b9e4, role.id=75f020c060fa465d828d5fcb8d48ad60, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:27.695577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240dbec-87cd-48e6-a0cb-0c7e9bba822a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.697003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240dbec-87cd-48e6-a0cb-0c7e9bba822a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.701298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55649632-2cd7-467b-ad82-7444e2b10b7e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.703417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 220/444] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/role_assignments?group.id=230e991d4587438583e577ffdc71b9e4&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=75f020c060fa465d828d5fcb8d48ad60 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:27.704203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240dbec-87cd-48e6-a0cb-0c7e9bba822a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.746443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb20dc-5e2b-4104-8886-ec04b08bd5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.747686 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb20dc-5e2b-4104-8886-ec04b08bd5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.748091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb20dc-5e2b-4104-8886-ec04b08bd5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.748371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb20dc-5e2b-4104-8886-ec04b08bd5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.749098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb20dc-5e2b-4104-8886-ec04b08bd5d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:27.749404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb20dc-5e2b-4104-8886-ec04b08bd5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.751261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb20dc-5e2b-4104-8886-ec04b08bd5d4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.768572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 225/445] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:27.768572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb20dc-5e2b-4104-8886-ec04b08bd5d4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.824665 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240dbec-87cd-48e6-a0cb-0c7e9bba822a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.864557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0368-8f1b-455b-a112-8de772e0566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.865266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0368-8f1b-455b-a112-8de772e0566e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.865617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0368-8f1b-455b-a112-8de772e0566e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.865996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0368-8f1b-455b-a112-8de772e0566e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.866890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0368-8f1b-455b-a112-8de772e0566e None admin] RBAC: Adding query filter params (group.id=230e991d4587438583e577ffdc71b9e4, role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=8ec546be13a842489477e0212c390b7d) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:27.867298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0368-8f1b-455b-a112-8de772e0566e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.868826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0368-8f1b-455b-a112-8de772e0566e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.876384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 221/446] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/role_assignments?group.id=230e991d4587438583e577ffdc71b9e4&scope.project.id=8ec546be13a842489477e0212c390b7d&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:27.877217 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0368-8f1b-455b-a112-8de772e0566e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.881386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:27.892991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb20dc-5e2b-4104-8886-ec04b08bd5d4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.939288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97205603-be48-4577-bec2-f09fa9fbbf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.939989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97205603-be48-4577-bec2-f09fa9fbbf96 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.940271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97205603-be48-4577-bec2-f09fa9fbbf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.940540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97205603-be48-4577-bec2-f09fa9fbbf96 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.941312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97205603-be48-4577-bec2-f09fa9fbbf96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:27.941614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97205603-be48-4577-bec2-f09fa9fbbf96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.943915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97205603-be48-4577-bec2-f09fa9fbbf96 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.954865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 226/447] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:27.960868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97205603-be48-4577-bec2-f09fa9fbbf96 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.973815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:28.003941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0368-8f1b-455b-a112-8de772e0566e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.045460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abada56-b3c0-4a96-966f-f8dadc971d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.046103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abada56-b3c0-4a96-966f-f8dadc971d91 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.046375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abada56-b3c0-4a96-966f-f8dadc971d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.046676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abada56-b3c0-4a96-966f-f8dadc971d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.080710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97205603-be48-4577-bec2-f09fa9fbbf96 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.127764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abada56-b3c0-4a96-966f-f8dadc971d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.129233 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abada56-b3c0-4a96-966f-f8dadc971d91 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.131195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:28.137013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c320-f897-486b-a3a8-b3913b3dc9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.137975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c320-f897-486b-a3a8-b3913b3dc9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.138805 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c320-f897-486b-a3a8-b3913b3dc9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.138930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c320-f897-486b-a3a8-b3913b3dc9b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.225613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256c320-f897-486b-a3a8-b3913b3dc9b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.227418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256c320-f897-486b-a3a8-b3913b3dc9b7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.238837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:28.259071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 222/448] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:28.265629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abada56-b3c0-4a96-966f-f8dadc971d91 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:28.348461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 227/449] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:28.354341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c320-f897-486b-a3a8-b3913b3dc9b7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:28.391747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abada56-b3c0-4a96-966f-f8dadc971d91 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.393474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:28.433113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b5d7c-3157-4838-b4fd-35827a1ec6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.433742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b5d7c-3157-4838-b4fd-35827a1ec6cc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.434018 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b5d7c-3157-4838-b4fd-35827a1ec6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.434289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b5d7c-3157-4838-b4fd-35827a1ec6cc None admin] PATH_INFO: `/v3/projects/677626bf39d04fc896037ceef125a07a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.435477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b5d7c-3157-4838-b4fd-35827a1ec6cc None admin] RBAC: Authorizing `identity:get_project(project_id=677626bf39d04fc896037ceef125a07a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.437472 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b5d7c-3157-4838-b4fd-35827a1ec6cc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.439191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 223/450] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:28 2022] GET /identity/v3/projects/677626bf39d04fc896037ceef125a07a => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:28.444736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b5d7c-3157-4838-b4fd-35827a1ec6cc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:28.469351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c320-f897-486b-a3a8-b3913b3dc9b7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.480874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:28.506936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6e8cb-2075-41b0-9e63-fc17361ad488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.507553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6e8cb-2075-41b0-9e63-fc17361ad488 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.507853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6e8cb-2075-41b0-9e63-fc17361ad488 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.508122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6e8cb-2075-41b0-9e63-fc17361ad488 None admin] PATH_INFO: `/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.509290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6e8cb-2075-41b0-9e63-fc17361ad488 None admin] RBAC: Authorizing `identity:get_project(project_id=35b1e7d3ffcf45218d7fde4dfa914a0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.510667 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6e8cb-2075-41b0-9e63-fc17361ad488 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.512302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 228/451] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:21:28 2022] GET /identity/v3/projects/35b1e7d3ffcf45218d7fde4dfa914a0c => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:28.517937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6e8cb-2075-41b0-9e63-fc17361ad488 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:28.541706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b5d7c-3157-4838-b4fd-35827a1ec6cc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.576387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b744a1-3ac6-4b0a-b98f-be4b58fe44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.577009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b744a1-3ac6-4b0a-b98f-be4b58fe44bd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.577315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b744a1-3ac6-4b0a-b98f-be4b58fe44bd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.577589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b744a1-3ac6-4b0a-b98f-be4b58fe44bd None admin] PATH_INFO: `/v3/groups/5ca8a4101f624243aa006d752f95bc1b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.578876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b744a1-3ac6-4b0a-b98f-be4b58fe44bd None admin] RBAC: Authorizing `identity:get_group(group_id=5ca8a4101f624243aa006d752f95bc1b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.580303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b744a1-3ac6-4b0a-b98f-be4b58fe44bd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.581865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 224/452] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:28 2022] GET /identity/v3/groups/5ca8a4101f624243aa006d752f95bc1b => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:28.587653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b744a1-3ac6-4b0a-b98f-be4b58fe44bd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:28.617448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6e8cb-2075-41b0-9e63-fc17361ad488 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.626900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:28.651208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0eab4-68cb-4f72-bcf7-202ed027ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.651830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0eab4-68cb-4f72-bcf7-202ed027ee12 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.652106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0eab4-68cb-4f72-bcf7-202ed027ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.652374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0eab4-68cb-4f72-bcf7-202ed027ee12 None admin] PATH_INFO: `/v3/groups/230e991d4587438583e577ffdc71b9e4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.653492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0eab4-68cb-4f72-bcf7-202ed027ee12 None admin] RBAC: Authorizing `identity:get_group(group_id=230e991d4587438583e577ffdc71b9e4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.654992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0eab4-68cb-4f72-bcf7-202ed027ee12 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.656706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 229/453] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 31 11:21:28 2022] GET /identity/v3/groups/230e991d4587438583e577ffdc71b9e4 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:28.663214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0eab4-68cb-4f72-bcf7-202ed027ee12 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:28.685582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b744a1-3ac6-4b0a-b98f-be4b58fe44bd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.711582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:28.720106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258802c-4edc-426d-8543-47021a7d68f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.720703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258802c-4edc-426d-8543-47021a7d68f6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.720977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258802c-4edc-426d-8543-47021a7d68f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.721494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258802c-4edc-426d-8543-47021a7d68f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.722204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258802c-4edc-426d-8543-47021a7d68f6 None admin] RBAC: Adding query filter params (group.id=5ca8a4101f624243aa006d752f95bc1b, role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=677626bf39d04fc896037ceef125a07a) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:28.722505 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258802c-4edc-426d-8543-47021a7d68f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.723956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258802c-4edc-426d-8543-47021a7d68f6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.729590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 225/454] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:28 2022] GET /identity/v3/role_assignments?group.id=5ca8a4101f624243aa006d752f95bc1b&scope.project.id=677626bf39d04fc896037ceef125a07a&role.id=946af2ff291349299db56e09aacb6b03 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:28.769693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0eab4-68cb-4f72-bcf7-202ed027ee12 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.806617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b8eac-10c7-4f97-b2b8-21d3aba1b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.807259 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b8eac-10c7-4f97-b2b8-21d3aba1b38d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.807537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b8eac-10c7-4f97-b2b8-21d3aba1b38d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.807810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b8eac-10c7-4f97-b2b8-21d3aba1b38d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.808551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b8eac-10c7-4f97-b2b8-21d3aba1b38d None admin] RBAC: Adding query filter params (group.id=230e991d4587438583e577ffdc71b9e4, role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:28.808858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b8eac-10c7-4f97-b2b8-21d3aba1b38d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.810332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b8eac-10c7-4f97-b2b8-21d3aba1b38d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.817542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 230/455] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 31 11:21:28 2022] GET /identity/v3/role_assignments?group.id=230e991d4587438583e577ffdc71b9e4&scope.project.id=35b1e7d3ffcf45218d7fde4dfa914a0c&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:31.402533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5104-66ae-4a7c-b394-52692cf7856e None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.403084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5104-66ae-4a7c-b394-52692cf7856e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.403084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5104-66ae-4a7c-b394-52692cf7856e None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.404709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 226/456] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:31.409664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b560d-2f36-401b-bc8c-d218cc20a0a3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.410085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b560d-2f36-401b-bc8c-d218cc20a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.410255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b560d-2f36-401b-bc8c-d218cc20a0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.434378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39ec7-456f-4ffe-9ae5-80040f3ee5ec None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.434713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39ec7-456f-4ffe-9ae5-80040f3ee5ec None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.434958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39ec7-456f-4ffe-9ae5-80040f3ee5ec None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.436605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 227/457] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:21:31.442022 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e50b560d-2f36-401b-bc8c-d218cc20a0a3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:31.442491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bfab6-1838-4f07-b61b-c0263af13435 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.442804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bfab6-1838-4f07-b61b-c0263af13435 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.443076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bfab6-1838-4f07-b61b-c0263af13435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.443255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e50b560d-2f36-401b-bc8c-d218cc20a0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:31.470979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-be1bfab6-1838-4f07-b61b-c0263af13435 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:31.472426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-be1bfab6-1838-4f07-b61b-c0263af13435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:31.536639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 231/458] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:31.584383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 228/459] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:31.771588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e912b-107a-4f83-9c40-718223a99f6e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.771912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e912b-107a-4f83-9c40-718223a99f6e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.772135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e912b-107a-4f83-9c40-718223a99f6e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.773722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 232/460] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:31.778929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08109d2a-2e0b-4c8a-a63d-66bb08b44044 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.779214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08109d2a-2e0b-4c8a-a63d-66bb08b44044 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.779614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08109d2a-2e0b-4c8a-a63d-66bb08b44044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.803740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-08109d2a-2e0b-4c8a-a63d-66bb08b44044 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:31.804995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-08109d2a-2e0b-4c8a-a63d-66bb08b44044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:31.839268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:31.891994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 229/461] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:31.934116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e912b-107a-4f83-9c40-718223a99f6e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:31.946178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08109d2a-2e0b-4c8a-a63d-66bb08b44044 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.001844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:32.094834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08109d2a-2e0b-4c8a-a63d-66bb08b44044 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.114460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e912b-107a-4f83-9c40-718223a99f6e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.148397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eec091-3b20-4945-ad0f-daa362d3a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.149040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eec091-3b20-4945-ad0f-daa362d3a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.149318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eec091-3b20-4945-ad0f-daa362d3a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.149586 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eec091-3b20-4945-ad0f-daa362d3a1e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.169816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eec091-3b20-4945-ad0f-daa362d3a1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.172032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eec091-3b20-4945-ad0f-daa362d3a1e5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.176823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a43aa6-507a-492a-b3db-d2be0c9583e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.177510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a43aa6-507a-492a-b3db-d2be0c9583e7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.177789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a43aa6-507a-492a-b3db-d2be0c9583e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.178057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a43aa6-507a-492a-b3db-d2be0c9583e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.189415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a43aa6-507a-492a-b3db-d2be0c9583e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.190907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a43aa6-507a-492a-b3db-d2be0c9583e7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a6a43aa6-507a-492a-b3db-d2be0c9583e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:32.206598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:32.207560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:32.208539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:32.208539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:32.208539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:32.208539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 233/462] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-74eec091-3b20-4945-ad0f-daa362d3a1e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:32.211816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:32.212677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:32.213567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:32.213567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:32.213567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:32.213567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 230/463] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:32.217021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a43aa6-507a-492a-b3db-d2be0c9583e7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.219329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eec091-3b20-4945-ad0f-daa362d3a1e5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.255379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:32.330449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:32.341792 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a43aa6-507a-492a-b3db-d2be0c9583e7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.351780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eec091-3b20-4945-ad0f-daa362d3a1e5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.381614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9335-1db3-4b11-9ca7-deef788d4db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.382227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9335-1db3-4b11-9ca7-deef788d4db2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.382511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9335-1db3-4b11-9ca7-deef788d4db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.382838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9335-1db3-4b11-9ca7-deef788d4db2 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.383492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a9335-1db3-4b11-9ca7-deef788d4db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:32.383797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a9335-1db3-4b11-9ca7-deef788d4db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.385211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a9335-1db3-4b11-9ca7-deef788d4db2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.387985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4153a-f4e1-46da-8170-4d80896dbf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.388784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4153a-f4e1-46da-8170-4d80896dbf93 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.389221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4153a-f4e1-46da-8170-4d80896dbf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.389496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4153a-f4e1-46da-8170-4d80896dbf93 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.390167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4153a-f4e1-46da-8170-4d80896dbf93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:32.390470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4153a-f4e1-46da-8170-4d80896dbf93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.391876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4153a-f4e1-46da-8170-4d80896dbf93 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.403071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 234/464] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:32.403735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9335-1db3-4b11-9ca7-deef788d4db2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.412861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 231/465] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:32.412861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439dab-f53e-4700-8ddb-9ed1ee01401c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.412861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439dab-f53e-4700-8ddb-9ed1ee01401c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.412861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439dab-f53e-4700-8ddb-9ed1ee01401c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.416010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 232/466] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:32.416703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439dab-f53e-4700-8ddb-9ed1ee01401c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.496549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:32.518883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9335-1db3-4b11-9ca7-deef788d4db2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.524068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439dab-f53e-4700-8ddb-9ed1ee01401c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.556733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1bc19-b112-4bfb-a9ba-73c0e8cb5567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.557530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1bc19-b112-4bfb-a9ba-73c0e8cb5567 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.557916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1bc19-b112-4bfb-a9ba-73c0e8cb5567 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.558298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1bc19-b112-4bfb-a9ba-73c0e8cb5567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.559300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff274f-017c-477a-87e6-4707900c0917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.559895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff274f-017c-477a-87e6-4707900c0917 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.560169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff274f-017c-477a-87e6-4707900c0917 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.560429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff274f-017c-477a-87e6-4707900c0917 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.561065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff274f-017c-477a-87e6-4707900c0917 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.562858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff274f-017c-477a-87e6-4707900c0917 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.571537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1bc19-b112-4bfb-a9ba-73c0e8cb5567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.573205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1bc19-b112-4bfb-a9ba-73c0e8cb5567 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.590725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 233/467] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/users => generated 248 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:32.590725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff274f-017c-477a-87e6-4707900c0917 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-33b1bc19-b112-4bfb-a9ba-73c0e8cb5567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:32.591005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:32.591818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:32.592672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:32.592672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:32.592672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:32.592672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 235/468] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:32.592672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a12f2-4ebe-412e-aa8f-5ccba57a2c05 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.592672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a12f2-4ebe-412e-aa8f-5ccba57a2c05 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.592672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a12f2-4ebe-412e-aa8f-5ccba57a2c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.605285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:32.619654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f92a12f2-4ebe-412e-aa8f-5ccba57a2c05 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:32.620945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f92a12f2-4ebe-412e-aa8f-5ccba57a2c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:32.704235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 236/469] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:32.705248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a12f2-4ebe-412e-aa8f-5ccba57a2c05 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.740359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff274f-017c-477a-87e6-4707900c0917 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.778739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:32.786951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c7e88-9772-4fd1-9655-db404e7c861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.787790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7e88-9772-4fd1-9655-db404e7c861a None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.788275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7e88-9772-4fd1-9655-db404e7c861a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.788692 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7e88-9772-4fd1-9655-db404e7c861a None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.789551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c7e88-9772-4fd1-9655-db404e7c861a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.793116 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c7e88-9772-4fd1-9655-db404e7c861a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.816449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 234/470] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/users => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:32.818093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25e04-64a4-4594-8279-88e094a5d4ff None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.818579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25e04-64a4-4594-8279-88e094a5d4ff None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.819147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a25e04-64a4-4594-8279-88e094a5d4ff None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.820624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 235/471] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:32.828462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf67463-0d99-47a7-8a37-82be33a0e677 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.828775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf67463-0d99-47a7-8a37-82be33a0e677 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.829014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf67463-0d99-47a7-8a37-82be33a0e677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.837294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a12f2-4ebe-412e-aa8f-5ccba57a2c05 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.856060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-acf67463-0d99-47a7-8a37-82be33a0e677 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:32.857959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-acf67463-0d99-47a7-8a37-82be33a0e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:32.879335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:32.887118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fca55-9757-44dd-9c12-12f974ee1bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.888884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fca55-9757-44dd-9c12-12f974ee1bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.889377 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fca55-9757-44dd-9c12-12f974ee1bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.890465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fca55-9757-44dd-9c12-12f974ee1bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.891442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fca55-9757-44dd-9c12-12f974ee1bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:32.891958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fca55-9757-44dd-9c12-12f974ee1bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.893835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fca55-9757-44dd-9c12-12f974ee1bb9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.908673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 237/472] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:32.914008 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fca55-9757-44dd-9c12-12f974ee1bb9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.957171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 236/473] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:33.001242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf67463-0d99-47a7-8a37-82be33a0e677 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:33.043030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fca55-9757-44dd-9c12-12f974ee1bb9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:33.097257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee0b8-7710-4f01-afc2-f998e6bb7fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:33.097257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee0b8-7710-4f01-afc2-f998e6bb7fc2 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:33.097257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee0b8-7710-4f01-afc2-f998e6bb7fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:33.097608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee0b8-7710-4f01-afc2-f998e6bb7fc2 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:33.098036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ee0b8-7710-4f01-afc2-f998e6bb7fc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:33.099518 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ee0b8-7710-4f01-afc2-f998e6bb7fc2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:33.127041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 238/474] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:33.133375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf67463-0d99-47a7-8a37-82be33a0e677 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:33.155524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:33.183056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ccd6a-eb9f-4bb1-b40c-c42fe9f3d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:33.183698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ccd6a-eb9f-4bb1-b40c-c42fe9f3d847 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:33.183975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ccd6a-eb9f-4bb1-b40c-c42fe9f3d847 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:33.184242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ccd6a-eb9f-4bb1-b40c-c42fe9f3d847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:33.197554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ccd6a-eb9f-4bb1-b40c-c42fe9f3d847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:33.199046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ccd6a-eb9f-4bb1-b40c-c42fe9f3d847 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-d90ccd6a-eb9f-4bb1-b40c-c42fe9f3d847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:33.215565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:33.216602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:33.217979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:33.217979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:33.217979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:33.217979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 237/475] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:33.223882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee0b8-7710-4f01-afc2-f998e6bb7fc2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:33.256334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ccd6a-eb9f-4bb1-b40c-c42fe9f3d847 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:33.287856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:33.347843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee0b8-7710-4f01-afc2-f998e6bb7fc2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:33.385916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65356e38-0270-41de-8fa3-778856997a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:33.386533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65356e38-0270-41de-8fa3-778856997a92 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:33.386851 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65356e38-0270-41de-8fa3-778856997a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:33.387393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65356e38-0270-41de-8fa3-778856997a92 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:33.388050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65356e38-0270-41de-8fa3-778856997a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:33.388355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65356e38-0270-41de-8fa3-778856997a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:33.390787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65356e38-0270-41de-8fa3-778856997a92 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:33.399211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ccd6a-eb9f-4bb1-b40c-c42fe9f3d847 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:33.409705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 239/476] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:33.413540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65356e38-0270-41de-8fa3-778856997a92 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:33.445066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:33.445713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:33.445954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:33.446228 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:33.446943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:33.448379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:33.460145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.sql.core [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 11:21:33.460145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 11:21:33.460145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [parameters: {'id': 'e709820cbdf04423979d2645ab4d55b7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 11:21:33.460145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81448) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application conn.query(q) Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result.read() Aug 31 11:21:33.481119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 11:21:33.482038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application next(self.gen) Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application yield resource Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application next(self.gen) Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise self.value Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application session.commit() Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 11:21:33.482951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.session.flush() Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application compat.raise_( Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 11:21:33.483850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 11:21:33.484712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application conn.query(q) Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result.read() Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 11:21:33.486937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [parameters: {'id': 'e709820cbdf04423979d2645ab4d55b7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:33.488040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 11:21:33.489371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:33.494386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 238/477] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 31 11:21:33 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:33.494386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:33.530960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:33.551769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65356e38-0270-41de-8fa3-778856997a92 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:33.563051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:33.594069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c9da-ed71-4934-90f9-dd0e08454ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:33.594700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c9da-ed71-4934-90f9-dd0e08454ca7 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:33.594987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c9da-ed71-4934-90f9-dd0e08454ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:33.595261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c9da-ed71-4934-90f9-dd0e08454ca7 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:33.595914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c9da-ed71-4934-90f9-dd0e08454ca7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:33.597653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c9da-ed71-4934-90f9-dd0e08454ca7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:33.611402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de63e6-f52d-4897-bc49-07a6a7287cb4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:33.622732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 240/478] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:21:33 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:33.662970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0075b-9d38-444a-a303-c1cc27b7886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:33.664082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0075b-9d38-444a-a303-c1cc27b7886c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:33.664694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0075b-9d38-444a-a303-c1cc27b7886c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:33.665164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0075b-9d38-444a-a303-c1cc27b7886c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:33.693836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0075b-9d38-444a-a303-c1cc27b7886c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8ce0075b-9d38-444a-a303-c1cc27b7886c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:33.699893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:33.700882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 11:21:33.701694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:33.704613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 239/479] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:21:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:33.715859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c9da-ed71-4934-90f9-dd0e08454ca7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:33.852578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c9da-ed71-4934-90f9-dd0e08454ca7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:33.889781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90bc6c-5c90-4501-acce-9529af841edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:33.890644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90bc6c-5c90-4501-acce-9529af841edc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:33.890999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90bc6c-5c90-4501-acce-9529af841edc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:33.891272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90bc6c-5c90-4501-acce-9529af841edc None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:33.891935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90bc6c-5c90-4501-acce-9529af841edc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:33.892233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90bc6c-5c90-4501-acce-9529af841edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:33.893649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90bc6c-5c90-4501-acce-9529af841edc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:33.902139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 241/480] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:35.208016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd9457-296f-459a-a83a-e4b126f4a843 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:35.208540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd9457-296f-459a-a83a-e4b126f4a843 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:35.208540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd9457-296f-459a-a83a-e4b126f4a843 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:35.210147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 240/481] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:35.215151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720985a0-29e5-4926-9a16-db5795e925c7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:35.215556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720985a0-29e5-4926-9a16-db5795e925c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:35.215722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720985a0-29e5-4926-9a16-db5795e925c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:35.236798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-720985a0-29e5-4926-9a16-db5795e925c7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:35.237978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-720985a0-29e5-4926-9a16-db5795e925c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:35.259845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:35.310031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 242/482] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:35.502316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b569-eee7-4558-a8b7-fc0dec473688 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:35.502645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b569-eee7-4558-a8b7-fc0dec473688 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:35.502887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b569-eee7-4558-a8b7-fc0dec473688 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:35.504364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 241/483] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:35.509657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9900d-0864-476c-900f-243cc41bea15 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:35.509951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9900d-0864-476c-900f-243cc41bea15 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:35.510212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9900d-0864-476c-900f-243cc41bea15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:35.533045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4bf9900d-0864-476c-900f-243cc41bea15 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:35.534216 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4bf9900d-0864-476c-900f-243cc41bea15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:35.626809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 243/484] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:35.647647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4c98-4d7d-4281-9b96-33a92c0e58bf None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:35.647920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4c98-4d7d-4281-9b96-33a92c0e58bf None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:35.648193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4c98-4d7d-4281-9b96-33a92c0e58bf None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:35.649762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 242/485] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:35.654964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d528eae-22af-42a6-98f5-938432250ef0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:35.655300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d528eae-22af-42a6-98f5-938432250ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:35.655773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d528eae-22af-42a6-98f5-938432250ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:35.685783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6d528eae-22af-42a6-98f5-938432250ef0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:35.687817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6d528eae-22af-42a6-98f5-938432250ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:35.694502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf4c98-4d7d-4281-9b96-33a92c0e58bf None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:35.790246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 244/486] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:35.866421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:35.877579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf4c98-4d7d-4281-9b96-33a92c0e58bf None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:35.925075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a5c69-d413-4637-b10d-5d538974da70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:35.925708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a5c69-d413-4637-b10d-5d538974da70 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:35.925988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a5c69-d413-4637-b10d-5d538974da70 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:35.926257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a5c69-d413-4637-b10d-5d538974da70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:35.946863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a5c69-d413-4637-b10d-5d538974da70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6b7a5c69-d413-4637-b10d-5d538974da70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:35.951632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:35.952575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:35.953369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:35.953967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 243/487] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:35.959464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d528eae-22af-42a6-98f5-938432250ef0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:35.982543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.086910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d528eae-22af-42a6-98f5-938432250ef0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.100136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a5c69-d413-4637-b10d-5d538974da70 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:36.140176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996a6ba-e6b4-4f2d-9223-fdcfc50afedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.140891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996a6ba-e6b4-4f2d-9223-fdcfc50afedc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.141288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996a6ba-e6b4-4f2d-9223-fdcfc50afedc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.141564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996a6ba-e6b4-4f2d-9223-fdcfc50afedc None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.142229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996a6ba-e6b4-4f2d-9223-fdcfc50afedc None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:36.142526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996a6ba-e6b4-4f2d-9223-fdcfc50afedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:36.143948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996a6ba-e6b4-4f2d-9223-fdcfc50afedc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:36.153126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 245/488] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:36.154521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b6d82-0554-44ab-a17d-4b72f1b488e4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.154984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b6d82-0554-44ab-a17d-4b72f1b488e4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.155543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b6d82-0554-44ab-a17d-4b72f1b488e4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.157152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 246/489] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:36.161999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b6d82-0554-44ab-a17d-4b72f1b488e4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:36.226074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a5c69-d413-4637-b10d-5d538974da70 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.243908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.261359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca1ffb-f50f-4d7e-903a-d816a8e9cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.261996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca1ffb-f50f-4d7e-903a-d816a8e9cc68 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.262272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca1ffb-f50f-4d7e-903a-d816a8e9cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.262536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca1ffb-f50f-4d7e-903a-d816a8e9cc68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.272283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b6d82-0554-44ab-a17d-4b72f1b488e4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.273766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca1ffb-f50f-4d7e-903a-d816a8e9cc68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-d1ca1ffb-f50f-4d7e-903a-d816a8e9cc68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:36.278973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:36.279880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:36.281245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 244/490] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:36.282415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b89e58-4ca5-4c99-858c-61deba8ccd9d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.282415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b89e58-4ca5-4c99-858c-61deba8ccd9d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.282642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b89e58-4ca5-4c99-858c-61deba8ccd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.301787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-37b89e58-4ca5-4c99-858c-61deba8ccd9d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:36.302970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-37b89e58-4ca5-4c99-858c-61deba8ccd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:36.310896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.313289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252084b-aee7-491b-a815-fdeb09aaa41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.314143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252084b-aee7-491b-a815-fdeb09aaa41a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.314600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252084b-aee7-491b-a815-fdeb09aaa41a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.315092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252084b-aee7-491b-a815-fdeb09aaa41a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.326344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252084b-aee7-491b-a815-fdeb09aaa41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:36.328776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252084b-aee7-491b-a815-fdeb09aaa41a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4252084b-aee7-491b-a815-fdeb09aaa41a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:36.343677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:36.344790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:36.345624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:36.345624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:36.345624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:36.347601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 247/491] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:36.348611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252084b-aee7-491b-a815-fdeb09aaa41a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:36.391067 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 245/492] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:36.392663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b89e58-4ca5-4c99-858c-61deba8ccd9d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:36.458432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252084b-aee7-491b-a815-fdeb09aaa41a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.489974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.497219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130db7-9f93-461a-a402-4ec10aa7d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.497845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130db7-9f93-461a-a402-4ec10aa7d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.498120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130db7-9f93-461a-a402-4ec10aa7d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.498387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130db7-9f93-461a-a402-4ec10aa7d2a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.509766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9130db7-9f93-461a-a402-4ec10aa7d2a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:36.511553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b89e58-4ca5-4c99-858c-61deba8ccd9d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e9130db7-9f93-461a-a402-4ec10aa7d2a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:36.515192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:36.516235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 248/493] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:36.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130db7-9f93-461a-a402-4ec10aa7d2a2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:36.556083 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6675b7-2164-4368-bbdc-838f4ff9a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.556689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6675b7-2164-4368-bbdc-838f4ff9a556 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.556962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6675b7-2164-4368-bbdc-838f4ff9a556 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.557231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6675b7-2164-4368-bbdc-838f4ff9a556 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.557886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6675b7-2164-4368-bbdc-838f4ff9a556 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:36.558182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6675b7-2164-4368-bbdc-838f4ff9a556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:36.559571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6675b7-2164-4368-bbdc-838f4ff9a556 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:36.567794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 246/494] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:36.568845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4468-0bea-427d-87a1-62f4b14ca3e8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.569121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4468-0bea-427d-87a1-62f4b14ca3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.569392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4468-0bea-427d-87a1-62f4b14ca3e8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.570712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 247/495] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:36.575183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4468-0bea-427d-87a1-62f4b14ca3e8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:36.579936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.631062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130db7-9f93-461a-a402-4ec10aa7d2a2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.667171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ef664-e586-4753-a3eb-090470677ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.667784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ef664-e586-4753-a3eb-090470677ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.668067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ef664-e586-4753-a3eb-090470677ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.668343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ef664-e586-4753-a3eb-090470677ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.669028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ef664-e586-4753-a3eb-090470677ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:36.669329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ef664-e586-4753-a3eb-090470677ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:36.671060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ef664-e586-4753-a3eb-090470677ef3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:36.682456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 249/496] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:36.683369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ef664-e586-4753-a3eb-090470677ef3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:36.691431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4468-0bea-427d-87a1-62f4b14ca3e8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.726422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3652fe-2ea1-4e34-8b0b-7cfcbbe5aeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.727058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3652fe-2ea1-4e34-8b0b-7cfcbbe5aeda None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.727340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3652fe-2ea1-4e34-8b0b-7cfcbbe5aeda None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.727611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3652fe-2ea1-4e34-8b0b-7cfcbbe5aeda None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.728269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3652fe-2ea1-4e34-8b0b-7cfcbbe5aeda None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:36.728572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3652fe-2ea1-4e34-8b0b-7cfcbbe5aeda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:36.729934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3652fe-2ea1-4e34-8b0b-7cfcbbe5aeda None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:36.733845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.738195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 248/497] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:36.739378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72013c81-f798-4f3b-8c74-032b077c893c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.739653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72013c81-f798-4f3b-8c74-032b077c893c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.739931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72013c81-f798-4f3b-8c74-032b077c893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.756949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-72013c81-f798-4f3b-8c74-032b077c893c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:36.758257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-72013c81-f798-4f3b-8c74-032b077c893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:36.784426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ef664-e586-4753-a3eb-090470677ef3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.816532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.818495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa40f5-a499-42ce-828d-6b78183a00c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.819165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa40f5-a499-42ce-828d-6b78183a00c8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.819452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa40f5-a499-42ce-828d-6b78183a00c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.819724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa40f5-a499-42ce-828d-6b78183a00c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.824185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 249/498] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:36.824991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72013c81-f798-4f3b-8c74-032b077c893c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:36.830527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa40f5-a499-42ce-828d-6b78183a00c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:36.832021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa40f5-a499-42ce-828d-6b78183a00c8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0efa40f5-a499-42ce-828d-6b78183a00c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:36.847847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:36.848759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:36.849636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:36.849636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:36.849636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:36.849636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 250/499] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:36.849850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa40f5-a499-42ce-828d-6b78183a00c8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:36.946569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72013c81-f798-4f3b-8c74-032b077c893c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.957852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa40f5-a499-42ce-828d-6b78183a00c8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:36.959555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.983766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223ae3-6ff7-4985-bddf-34f9ab22099b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.984393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223ae3-6ff7-4985-bddf-34f9ab22099b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.984668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223ae3-6ff7-4985-bddf-34f9ab22099b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.984941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223ae3-6ff7-4985-bddf-34f9ab22099b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.994850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32223ae3-6ff7-4985-bddf-34f9ab22099b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:36.996199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c72bcc-51ae-40c6-a49e-5cf866d5ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:36.997024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c72bcc-51ae-40c6-a49e-5cf866d5ed23 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:36.997482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c72bcc-51ae-40c6-a49e-5cf866d5ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:36.997953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c72bcc-51ae-40c6-a49e-5cf866d5ed23 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-32223ae3-6ff7-4985-bddf-34f9ab22099b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:36.999593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:37.000470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:37.001271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 250/500] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:37.002173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223ae3-6ff7-4985-bddf-34f9ab22099b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.009192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c72bcc-51ae-40c6-a49e-5cf866d5ed23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.010944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c72bcc-51ae-40c6-a49e-5cf866d5ed23 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-41c72bcc-51ae-40c6-a49e-5cf866d5ed23 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:37.025514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:37.026675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 11:21:37.027782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:37.028834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 251/501] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:37.029719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c72bcc-51ae-40c6-a49e-5cf866d5ed23 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.067131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.112319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223ae3-6ff7-4985-bddf-34f9ab22099b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.137822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c72bcc-51ae-40c6-a49e-5cf866d5ed23 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.146529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868edbe-ee86-4e3c-a23f-e5e8b283e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.147260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868edbe-ee86-4e3c-a23f-e5e8b283e35f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.147612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868edbe-ee86-4e3c-a23f-e5e8b283e35f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.147883 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868edbe-ee86-4e3c-a23f-e5e8b283e35f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.157879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868edbe-ee86-4e3c-a23f-e5e8b283e35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.159365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868edbe-ee86-4e3c-a23f-e5e8b283e35f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.171162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50629c9-e28b-4b58-9298-1e170c8d2292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.171757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50629c9-e28b-4b58-9298-1e170c8d2292 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.172035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50629c9-e28b-4b58-9298-1e170c8d2292 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.172305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50629c9-e28b-4b58-9298-1e170c8d2292 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.172939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50629c9-e28b-4b58-9298-1e170c8d2292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:37.173237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50629c9-e28b-4b58-9298-1e170c8d2292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-b868edbe-ee86-4e3c-a23f-e5e8b283e35f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:37.173938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:37.174996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:37.175858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:37.175858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:37.175858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:37.176019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50629c9-e28b-4b58-9298-1e170c8d2292 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.176092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 251/502] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:37.176259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868edbe-ee86-4e3c-a23f-e5e8b283e35f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.191151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 252/503] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:37.192048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50629c9-e28b-4b58-9298-1e170c8d2292 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.217299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.274417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868edbe-ee86-4e3c-a23f-e5e8b283e35f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.283248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.292484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50629c9-e28b-4b58-9298-1e170c8d2292 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.308656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920d2c-182e-48f4-9d5a-1734c2d031c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.309250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920d2c-182e-48f4-9d5a-1734c2d031c4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.309550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920d2c-182e-48f4-9d5a-1734c2d031c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.309823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920d2c-182e-48f4-9d5a-1734c2d031c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.310470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79920d2c-182e-48f4-9d5a-1734c2d031c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:37.310796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79920d2c-182e-48f4-9d5a-1734c2d031c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.312709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79920d2c-182e-48f4-9d5a-1734c2d031c4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.320462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 252/504] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:37.321231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920d2c-182e-48f4-9d5a-1734c2d031c4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.331053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b899622-154f-4691-9e9e-84d1af106d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.331661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b899622-154f-4691-9e9e-84d1af106d5f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.331937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b899622-154f-4691-9e9e-84d1af106d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.332206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b899622-154f-4691-9e9e-84d1af106d5f None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.332935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b899622-154f-4691-9e9e-84d1af106d5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:37.333236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b899622-154f-4691-9e9e-84d1af106d5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.334671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b899622-154f-4691-9e9e-84d1af106d5f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.371057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 253/505] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:37.371881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b899622-154f-4691-9e9e-84d1af106d5f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.418706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920d2c-182e-48f4-9d5a-1734c2d031c4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.451196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.451355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27143f63-9e9a-43cc-ada6-979605b4720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.451913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27143f63-9e9a-43cc-ada6-979605b4720a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.452798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27143f63-9e9a-43cc-ada6-979605b4720a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.453138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27143f63-9e9a-43cc-ada6-979605b4720a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.463631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27143f63-9e9a-43cc-ada6-979605b4720a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.465082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27143f63-9e9a-43cc-ada6-979605b4720a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.472274 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b899622-154f-4691-9e9e-84d1af106d5f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-27143f63-9e9a-43cc-ada6-979605b4720a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:37.480805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:37.481865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:37.482956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:37.482956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:37.482956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:37.487063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 253/506] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:37.487848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27143f63-9e9a-43cc-ada6-979605b4720a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.506477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369f81-4015-4a0f-a696-4a83e5fe7be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.507108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369f81-4015-4a0f-a696-4a83e5fe7be0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.507414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369f81-4015-4a0f-a696-4a83e5fe7be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.507685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369f81-4015-4a0f-a696-4a83e5fe7be0 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.508321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08369f81-4015-4a0f-a696-4a83e5fe7be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:37.508618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08369f81-4015-4a0f-a696-4a83e5fe7be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.509992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08369f81-4015-4a0f-a696-4a83e5fe7be0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.510942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.522261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 254/507] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:37.523009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369f81-4015-4a0f-a696-4a83e5fe7be0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.585461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27143f63-9e9a-43cc-ada6-979605b4720a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.618068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b29b05-7848-4935-b78a-340a294f128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.618704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29b05-7848-4935-b78a-340a294f128a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.618987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29b05-7848-4935-b78a-340a294f128a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.619254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29b05-7848-4935-b78a-340a294f128a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.620757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369f81-4015-4a0f-a696-4a83e5fe7be0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.627176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b29b05-7848-4935-b78a-340a294f128a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.628621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b29b05-7848-4935-b78a-340a294f128a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-75b29b05-7848-4935-b78a-340a294f128a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:37.641167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:37.642151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 254/508] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:37.643479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b29b05-7848-4935-b78a-340a294f128a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.658994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701ac75-8434-4e58-9410-d1e3c671c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.659721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701ac75-8434-4e58-9410-d1e3c671c450 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.660008 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701ac75-8434-4e58-9410-d1e3c671c450 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.660279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701ac75-8434-4e58-9410-d1e3c671c450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.669194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.671840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701ac75-8434-4e58-9410-d1e3c671c450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.673374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701ac75-8434-4e58-9410-d1e3c671c450 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b701ac75-8434-4e58-9410-d1e3c671c450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:37.688236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:37.689195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:37.690103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:37.690103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:37.690103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:37.690103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 255/509] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:37.690103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701ac75-8434-4e58-9410-d1e3c671c450 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.729805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.748678 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b29b05-7848-4935-b78a-340a294f128a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.782170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e727b-def7-474a-9b6c-cb930c76e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.782789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e727b-def7-474a-9b6c-cb930c76e839 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.783070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e727b-def7-474a-9b6c-cb930c76e839 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.783336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e727b-def7-474a-9b6c-cb930c76e839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.797939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701ac75-8434-4e58-9410-d1e3c671c450 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.831540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e48d89-1711-4d5c-85bf-c326a378e4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.832139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e48d89-1711-4d5c-85bf-c326a378e4ba None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.832417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e48d89-1711-4d5c-85bf-c326a378e4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.832684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e48d89-1711-4d5c-85bf-c326a378e4ba None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.833319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e48d89-1711-4d5c-85bf-c326a378e4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:37.833618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e48d89-1711-4d5c-85bf-c326a378e4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.835024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e48d89-1711-4d5c-85bf-c326a378e4ba None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.846607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 256/510] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:37.847421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e48d89-1711-4d5c-85bf-c326a378e4ba None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.853809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e727b-def7-474a-9b6c-cb930c76e839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.855308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e727b-def7-474a-9b6c-cb930c76e839 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:37.899290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.936112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.949776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e48d89-1711-4d5c-85bf-c326a378e4ba None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:37.955728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 255/511] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:37.956599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e727b-def7-474a-9b6c-cb930c76e839 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:37.985838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc23247-6abf-4f53-bbd7-aebff35d72e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:37.986394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc23247-6abf-4f53-bbd7-aebff35d72e6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:37.986669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc23247-6abf-4f53-bbd7-aebff35d72e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:37.986958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc23247-6abf-4f53-bbd7-aebff35d72e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:37.993732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc23247-6abf-4f53-bbd7-aebff35d72e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:37.995217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc23247-6abf-4f53-bbd7-aebff35d72e6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cbc23247-6abf-4f53-bbd7-aebff35d72e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:38.006522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:38.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 257/512] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:38.008533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc23247-6abf-4f53-bbd7-aebff35d72e6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.060660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e727b-def7-474a-9b6c-cb930c76e839 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.093853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58dbeb-bcbe-4723-88ac-168eed3b40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.094444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58dbeb-bcbe-4723-88ac-168eed3b40d3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.094741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58dbeb-bcbe-4723-88ac-168eed3b40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.095014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58dbeb-bcbe-4723-88ac-168eed3b40d3 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.095738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58dbeb-bcbe-4723-88ac-168eed3b40d3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:38.096036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58dbeb-bcbe-4723-88ac-168eed3b40d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.097701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58dbeb-bcbe-4723-88ac-168eed3b40d3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.104606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc23247-6abf-4f53-bbd7-aebff35d72e6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.117679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.133652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 256/513] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 31 11:21:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:38.134447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58dbeb-bcbe-4723-88ac-168eed3b40d3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.138698 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81926683-b166-43ac-859b-77ddbd708890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.139309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81926683-b166-43ac-859b-77ddbd708890 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.140141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81926683-b166-43ac-859b-77ddbd708890 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.140416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81926683-b166-43ac-859b-77ddbd708890 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.141052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81926683-b166-43ac-859b-77ddbd708890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:38.141348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81926683-b166-43ac-859b-77ddbd708890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.142750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81926683-b166-43ac-859b-77ddbd708890 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.154741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 258/514] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:38.156042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81926683-b166-43ac-859b-77ddbd708890 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.180500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.238431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58dbeb-bcbe-4723-88ac-168eed3b40d3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.254909 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81926683-b166-43ac-859b-77ddbd708890 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.272000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d3c6-4d06-43df-95e4-91bac1e2b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.272612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d3c6-4d06-43df-95e4-91bac1e2b6b2 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.272888 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d3c6-4d06-43df-95e4-91bac1e2b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.273187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d3c6-4d06-43df-95e4-91bac1e2b6b2 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.273825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d3c6-4d06-43df-95e4-91bac1e2b6b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.275298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d3c6-4d06-43df-95e4-91bac1e2b6b2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.288531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65af2d-4235-4d52-a394-eb245a5b5830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.289192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65af2d-4235-4d52-a394-eb245a5b5830 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.289543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65af2d-4235-4d52-a394-eb245a5b5830 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.289814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65af2d-4235-4d52-a394-eb245a5b5830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.295674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 257/515] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:21:38 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:38.297454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d3c6-4d06-43df-95e4-91bac1e2b6b2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.312628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65af2d-4235-4d52-a394-eb245a5b5830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.314170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65af2d-4235-4d52-a394-eb245a5b5830 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6b65af2d-4235-4d52-a394-eb245a5b5830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:38.332166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:38.333290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:38.334135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:38.334135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:38.334135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:38.334135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 259/516] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:38.334349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65af2d-4235-4d52-a394-eb245a5b5830 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.367468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.416731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.425668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d3c6-4d06-43df-95e4-91bac1e2b6b2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.459040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65af2d-4235-4d52-a394-eb245a5b5830 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.464903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc83e9b-a742-471a-bba4-3baa202775fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.465707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc83e9b-a742-471a-bba4-3baa202775fc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.465989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc83e9b-a742-471a-bba4-3baa202775fc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.466735 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc83e9b-a742-471a-bba4-3baa202775fc None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.467489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc83e9b-a742-471a-bba4-3baa202775fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:38.468787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc83e9b-a742-471a-bba4-3baa202775fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.470798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc83e9b-a742-471a-bba4-3baa202775fc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.495136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 258/517] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 31 11:21:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:38.495718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc83e9b-a742-471a-bba4-3baa202775fc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.509949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510e2c3-225f-4d17-a62d-3b2750f579cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.511045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e2c3-225f-4d17-a62d-3b2750f579cc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.511396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e2c3-225f-4d17-a62d-3b2750f579cc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.511679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e2c3-225f-4d17-a62d-3b2750f579cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.586177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510e2c3-225f-4d17-a62d-3b2750f579cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.587822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510e2c3-225f-4d17-a62d-3b2750f579cc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.596161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc83e9b-a742-471a-bba4-3baa202775fc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.613013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.632862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9a7eb-52f0-474a-b273-c7405f378506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.633493 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9a7eb-52f0-474a-b273-c7405f378506 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.633772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9a7eb-52f0-474a-b273-c7405f378506 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.634043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9a7eb-52f0-474a-b273-c7405f378506 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.642104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9a7eb-52f0-474a-b273-c7405f378506 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.643592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9a7eb-52f0-474a-b273-c7405f378506 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7fb9a7eb-52f0-474a-b273-c7405f378506 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:38.655350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:38.656458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 259/518] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:38.657342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9a7eb-52f0-474a-b273-c7405f378506 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.678407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.701537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 260/519] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:38.703138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510e2c3-225f-4d17-a62d-3b2750f579cc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.773158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9a7eb-52f0-474a-b273-c7405f378506 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.808727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510e2c3-225f-4d17-a62d-3b2750f579cc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.810222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebd70e-a849-4579-ada6-658aedfa41df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.810861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd70e-a849-4579-ada6-658aedfa41df None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.812252 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd70e-a849-4579-ada6-658aedfa41df None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.812671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd70e-a849-4579-ada6-658aedfa41df None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.813330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebd70e-a849-4579-ada6-658aedfa41df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:38.813635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebd70e-a849-4579-ada6-658aedfa41df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.815038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebd70e-a849-4579-ada6-658aedfa41df None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.827070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 260/520] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:38.827894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebd70e-a849-4579-ada6-658aedfa41df None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.840136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.852496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf35ec-a9f2-4fee-87c9-430684b6f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.853099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf35ec-a9f2-4fee-87c9-430684b6f5af None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.853387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf35ec-a9f2-4fee-87c9-430684b6f5af None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.853668 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf35ec-a9f2-4fee-87c9-430684b6f5af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.908224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.929384 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf35ec-a9f2-4fee-87c9-430684b6f5af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.930893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf35ec-a9f2-4fee-87c9-430684b6f5af None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:38.938106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebd70e-a849-4579-ada6-658aedfa41df None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:38.977104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a696553-85c2-4360-9655-659403ad5f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:38.977924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a696553-85c2-4360-9655-659403ad5f60 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:38.978204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a696553-85c2-4360-9655-659403ad5f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:38.978472 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a696553-85c2-4360-9655-659403ad5f60 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:38.979343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a696553-85c2-4360-9655-659403ad5f60 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:38.979763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a696553-85c2-4360-9655-659403ad5f60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:38.981190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a696553-85c2-4360-9655-659403ad5f60 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.000292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 261/521] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 31 11:21:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:39.001175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a696553-85c2-4360-9655-659403ad5f60 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.036989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 261/522] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:39.037652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf35ec-a9f2-4fee-87c9-430684b6f5af None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.063333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:39.109575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a696553-85c2-4360-9655-659403ad5f60 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.142743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:39.146051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf35ec-a9f2-4fee-87c9-430684b6f5af None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.148319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb1eb8-fe34-45f3-b374-42319971b86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb1eb8-fe34-45f3-b374-42319971b86a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.149383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb1eb8-fe34-45f3-b374-42319971b86a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.149645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb1eb8-fe34-45f3-b374-42319971b86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.160351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb1eb8-fe34-45f3-b374-42319971b86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.161807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb1eb8-fe34-45f3-b374-42319971b86a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-9edb1eb8-fe34-45f3-b374-42319971b86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:39.177805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:39.179106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:39.180111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:39.180111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:39.180111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:39.180847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 262/523] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:39.181444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb1eb8-fe34-45f3-b374-42319971b86a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.188666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ec856-87ce-47be-b3d7-e4ca40192593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.189305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ec856-87ce-47be-b3d7-e4ca40192593 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.189587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ec856-87ce-47be-b3d7-e4ca40192593 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.189860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ec856-87ce-47be-b3d7-e4ca40192593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.196971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ec856-87ce-47be-b3d7-e4ca40192593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.198428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ec856-87ce-47be-b3d7-e4ca40192593 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a69ec856-87ce-47be-b3d7-e4ca40192593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:39.210807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:39.211942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:39.213034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:39.213034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:39.213034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:39.213034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:39.213034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:39.213034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:39.213034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:39.213034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:39.216877 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 262/524] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:39.217461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ec856-87ce-47be-b3d7-e4ca40192593 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.291648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb1eb8-fe34-45f3-b374-42319971b86a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.316066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:39.329748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afa7e-05d0-4b85-a3f7-5205c092ed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.330465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afa7e-05d0-4b85-a3f7-5205c092ed5d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.330847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afa7e-05d0-4b85-a3f7-5205c092ed5d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.331192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afa7e-05d0-4b85-a3f7-5205c092ed5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.334220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ec856-87ce-47be-b3d7-e4ca40192593 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.371087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff990-f09e-41c3-8e72-75eb380b0f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.371718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff990-f09e-41c3-8e72-75eb380b0f97 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.372001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff990-f09e-41c3-8e72-75eb380b0f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.372276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff990-f09e-41c3-8e72-75eb380b0f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.384307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff990-f09e-41c3-8e72-75eb380b0f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.385823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff990-f09e-41c3-8e72-75eb380b0f97 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.391873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-988ff990-f09e-41c3-8e72-75eb380b0f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:39.401097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:39.402288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:39.403327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:39.403327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:39.403327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:39.407616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 263/525] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:39.408502 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff990-f09e-41c3-8e72-75eb380b0f97 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.412972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3afa7e-05d0-4b85-a3f7-5205c092ed5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.414569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3afa7e-05d0-4b85-a3f7-5205c092ed5d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.515433 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff990-f09e-41c3-8e72-75eb380b0f97 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.525965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 263/526] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:39.525965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afa7e-05d0-4b85-a3f7-5205c092ed5d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.556102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258197d4-a0dc-4beb-9b8c-495fb4fa454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.556924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258197d4-a0dc-4beb-9b8c-495fb4fa454b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.557362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258197d4-a0dc-4beb-9b8c-495fb4fa454b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.557639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258197d4-a0dc-4beb-9b8c-495fb4fa454b None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.558285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258197d4-a0dc-4beb-9b8c-495fb4fa454b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:39.558589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258197d4-a0dc-4beb-9b8c-495fb4fa454b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.559988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258197d4-a0dc-4beb-9b8c-495fb4fa454b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.562229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:39.572686 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 264/527] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:39.573584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258197d4-a0dc-4beb-9b8c-495fb4fa454b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.618105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:39.638264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afa7e-05d0-4b85-a3f7-5205c092ed5d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.679865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258197d4-a0dc-4beb-9b8c-495fb4fa454b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.680155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cf5f0-0d9d-49f1-9651-6c5af46d6e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.680759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cf5f0-0d9d-49f1-9651-6c5af46d6e6a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.681030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cf5f0-0d9d-49f1-9651-6c5af46d6e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.681330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cf5f0-0d9d-49f1-9651-6c5af46d6e6a None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.682725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cf5f0-0d9d-49f1-9651-6c5af46d6e6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:39.682725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cf5f0-0d9d-49f1-9651-6c5af46d6e6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.683719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cf5f0-0d9d-49f1-9651-6c5af46d6e6a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.702655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 264/528] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:39.703512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cf5f0-0d9d-49f1-9651-6c5af46d6e6a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.730759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c10c7-4d8d-4837-8bd6-f36fbd180e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.731766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c10c7-4d8d-4837-8bd6-f36fbd180e22 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.732060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c10c7-4d8d-4837-8bd6-f36fbd180e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.732336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c10c7-4d8d-4837-8bd6-f36fbd180e22 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.732989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c10c7-4d8d-4837-8bd6-f36fbd180e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:39.733837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c10c7-4d8d-4837-8bd6-f36fbd180e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.735254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c10c7-4d8d-4837-8bd6-f36fbd180e22 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.751624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 265/529] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:39.751624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c10c7-4d8d-4837-8bd6-f36fbd180e22 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.807182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:39.815220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cf5f0-0d9d-49f1-9651-6c5af46d6e6a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.849864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb464a-9e2f-4910-83f7-0d656e635814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.850490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb464a-9e2f-4910-83f7-0d656e635814 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.850800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb464a-9e2f-4910-83f7-0d656e635814 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.851068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb464a-9e2f-4910-83f7-0d656e635814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.854145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c10c7-4d8d-4837-8bd6-f36fbd180e22 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.862278 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb464a-9e2f-4910-83f7-0d656e635814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.863773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb464a-9e2f-4910-83f7-0d656e635814 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.867654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-5dbb464a-9e2f-4910-83f7-0d656e635814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:39.881329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:39.882289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:39.883176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:39.883176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:39.883176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:39.883176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 265/530] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:39.883390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb464a-9e2f-4910-83f7-0d656e635814 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.893296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d4ba9-ab97-4a50-99ef-310da275b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.893930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4ba9-ab97-4a50-99ef-310da275b506 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.894207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4ba9-ab97-4a50-99ef-310da275b506 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.894476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4ba9-ab97-4a50-99ef-310da275b506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.901335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d4ba9-ab97-4a50-99ef-310da275b506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.902832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d4ba9-ab97-4a50-99ef-310da275b506 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-129d4ba9-ab97-4a50-99ef-310da275b506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:39.914941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:39.915840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:39.916681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:39.916681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:39.916681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:39.916681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:39.916681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:39.916681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:39.916681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:39.916681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:39.916681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 266/531] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:39.921297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d4ba9-ab97-4a50-99ef-310da275b506 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.996201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb464a-9e2f-4910-83f7-0d656e635814 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.025636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d4ba9-ab97-4a50-99ef-310da275b506 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.034855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc22f6-046b-49bc-8d31-eb37402fa46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.035469 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc22f6-046b-49bc-8d31-eb37402fa46c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.035746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc22f6-046b-49bc-8d31-eb37402fa46c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.036019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc22f6-046b-49bc-8d31-eb37402fa46c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.036748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc22f6-046b-49bc-8d31-eb37402fa46c None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=bb50ee2f9ccd4a258f3396074db66e74) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:40.037054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc22f6-046b-49bc-8d31-eb37402fa46c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.038537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc22f6-046b-49bc-8d31-eb37402fa46c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.043497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:40.044210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 266/532] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/role_assignments?user.id=bb50ee2f9ccd4a258f3396074db66e74&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:40.044755 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc22f6-046b-49bc-8d31-eb37402fa46c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.078565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e2c31-cb77-40a8-93a5-2a761f65209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.079763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e2c31-cb77-40a8-93a5-2a761f65209e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.080256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e2c31-cb77-40a8-93a5-2a761f65209e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.080753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e2c31-cb77-40a8-93a5-2a761f65209e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.089107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e2c31-cb77-40a8-93a5-2a761f65209e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.091026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e2c31-cb77-40a8-93a5-2a761f65209e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c87e2c31-cb77-40a8-93a5-2a761f65209e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:40.104677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:40.105605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:40.106452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:40.106452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:40.106452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:40.106452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:40.106452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:40.106452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:40.106452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:40.106452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:40.108932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 267/533] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:40.115187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e2c31-cb77-40a8-93a5-2a761f65209e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.131054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:40.192480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc22f6-046b-49bc-8d31-eb37402fa46c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.234630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e2c31-cb77-40a8-93a5-2a761f65209e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.235604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51330c8e-9535-4a9c-a5d7-79da1a8a4a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.236325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51330c8e-9535-4a9c-a5d7-79da1a8a4a1e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.236613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51330c8e-9535-4a9c-a5d7-79da1a8a4a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.236997 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51330c8e-9535-4a9c-a5d7-79da1a8a4a1e None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.237660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51330c8e-9535-4a9c-a5d7-79da1a8a4a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:40.237967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51330c8e-9535-4a9c-a5d7-79da1a8a4a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.239511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51330c8e-9535-4a9c-a5d7-79da1a8a4a1e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.253053 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 267/534] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:40.253894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51330c8e-9535-4a9c-a5d7-79da1a8a4a1e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.275325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2008027-7ffc-4d48-bd78-bf8f47d4ad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.275937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008027-7ffc-4d48-bd78-bf8f47d4ad50 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.276227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008027-7ffc-4d48-bd78-bf8f47d4ad50 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.276493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008027-7ffc-4d48-bd78-bf8f47d4ad50 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.277187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008027-7ffc-4d48-bd78-bf8f47d4ad50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:40.277509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008027-7ffc-4d48-bd78-bf8f47d4ad50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.279002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008027-7ffc-4d48-bd78-bf8f47d4ad50 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.298650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 268/535] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:40.300221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2008027-7ffc-4d48-bd78-bf8f47d4ad50 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.340439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:40.359548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51330c8e-9535-4a9c-a5d7-79da1a8a4a1e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.382274 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:40.397367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d94f1-d321-4252-bd59-c488b02af0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.397976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d94f1-d321-4252-bd59-c488b02af0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.398250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d94f1-d321-4252-bd59-c488b02af0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.398520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d94f1-d321-4252-bd59-c488b02af0a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.399242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d94f1-d321-4252-bd59-c488b02af0a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:40.399550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d94f1-d321-4252-bd59-c488b02af0a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.400978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d94f1-d321-4252-bd59-c488b02af0a2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.417341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 268/536] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:40.417341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc087e1-6fd3-4e12-ae7b-ba8a3868dd8a None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.417341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc087e1-6fd3-4e12-ae7b-ba8a3868dd8a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.417341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc087e1-6fd3-4e12-ae7b-ba8a3868dd8a None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.417341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 269/537] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:40.417341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc087e1-6fd3-4e12-ae7b-ba8a3868dd8a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.422536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2008027-7ffc-4d48-bd78-bf8f47d4ad50 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.459441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159690-9e68-4954-87c3-c7eded26a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.460070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159690-9e68-4954-87c3-c7eded26a474 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.460346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159690-9e68-4954-87c3-c7eded26a474 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.460615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159690-9e68-4954-87c3-c7eded26a474 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.468365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159690-9e68-4954-87c3-c7eded26a474 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.469778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159690-9e68-4954-87c3-c7eded26a474 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0c159690-9e68-4954-87c3-c7eded26a474 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:40.481598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:40.482452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:40.483449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:40.483449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:40.483449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:40.483449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:40.483449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:40.483449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:40.483449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:40.483449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:40.483449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 269/538] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:40.483916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159690-9e68-4954-87c3-c7eded26a474 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.531440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc087e1-6fd3-4e12-ae7b-ba8a3868dd8a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.565681 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeda63-e8ea-470e-85f3-63953c994032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.566426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeda63-e8ea-470e-85f3-63953c994032 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.566862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeda63-e8ea-470e-85f3-63953c994032 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.567235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeda63-e8ea-470e-85f3-63953c994032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.568061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeda63-e8ea-470e-85f3-63953c994032 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=0f4db8824b7e4ae6880840e3c8680610) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:40.568490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeda63-e8ea-470e-85f3-63953c994032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.569999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeda63-e8ea-470e-85f3-63953c994032 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.575913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 270/539] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:40 2022] GET /identity/v3/role_assignments?user.id=0f4db8824b7e4ae6880840e3c8680610&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:40.588257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb264d-987c-4bf2-a6e8-b152c9a1c749 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.588536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb264d-987c-4bf2-a6e8-b152c9a1c749 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.588815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb264d-987c-4bf2-a6e8-b152c9a1c749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.608531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:40.613614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3cdb264d-987c-4bf2-a6e8-b152c9a1c749 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:40.614466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159690-9e68-4954-87c3-c7eded26a474 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.614886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3cdb264d-987c-4bf2-a6e8-b152c9a1c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:40.656493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f784b-1afc-4285-9e0b-ebf8e03d5db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.657107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f784b-1afc-4285-9e0b-ebf8e03d5db5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.657388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f784b-1afc-4285-9e0b-ebf8e03d5db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.657660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f784b-1afc-4285-9e0b-ebf8e03d5db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.658513 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f784b-1afc-4285-9e0b-ebf8e03d5db5 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=76462c2e1ec447acbd2aba9e77ae00b1) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:40.658924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f784b-1afc-4285-9e0b-ebf8e03d5db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.660546 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f784b-1afc-4285-9e0b-ebf8e03d5db5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.674415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 270/540] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:40 2022] GET /identity/v3/role_assignments?user.id=76462c2e1ec447acbd2aba9e77ae00b1&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:40.674415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f784b-1afc-4285-9e0b-ebf8e03d5db5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.675909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:40.739199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 271/541] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:40.850831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f784b-1afc-4285-9e0b-ebf8e03d5db5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.897822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc6889-5ffd-48e3-b59b-78ce7e4de927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.898353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6889-5ffd-48e3-b59b-78ce7e4de927 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.898634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6889-5ffd-48e3-b59b-78ce7e4de927 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.898967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6889-5ffd-48e3-b59b-78ce7e4de927 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.899668 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc6889-5ffd-48e3-b59b-78ce7e4de927 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:40.899974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc6889-5ffd-48e3-b59b-78ce7e4de927 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.901428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc6889-5ffd-48e3-b59b-78ce7e4de927 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.922325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 271/542] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:40.927987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb264d-987c-4bf2-a6e8-b152c9a1c749 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:41.092205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb264d-987c-4bf2-a6e8-b152c9a1c749 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:41.120252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc6889-5ffd-48e3-b59b-78ce7e4de927 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:41.148475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68905c26-91a4-4f65-a8a1-591edb0d143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:41.149018 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68905c26-91a4-4f65-a8a1-591edb0d143a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:41.149297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68905c26-91a4-4f65-a8a1-591edb0d143a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:41.149570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68905c26-91a4-4f65-a8a1-591edb0d143a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:41.150316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68905c26-91a4-4f65-a8a1-591edb0d143a None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=e0f654bfe8364490a322b88433dd8fd2) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:41.154746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68905c26-91a4-4f65-a8a1-591edb0d143a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:41.154746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68905c26-91a4-4f65-a8a1-591edb0d143a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:41.155020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:41.164772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 272/543] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:40 2022] GET /identity/v3/role_assignments?user.id=e0f654bfe8364490a322b88433dd8fd2&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:41.242460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc6889-5ffd-48e3-b59b-78ce7e4de927 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:41.281627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f2286-bf54-4723-83a4-8fb39331c05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:41.282516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2286-bf54-4723-83a4-8fb39331c05d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:41.282981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2286-bf54-4723-83a4-8fb39331c05d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:41.283426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2286-bf54-4723-83a4-8fb39331c05d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:41.295684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f2286-bf54-4723-83a4-8fb39331c05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1a1f2286-bf54-4723-83a4-8fb39331c05d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:41.301239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:41.302295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:41.303285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:41.305465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 272/544] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:41.311325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68905c26-91a4-4f65-a8a1-591edb0d143a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:41.365974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:41.459500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68905c26-91a4-4f65-a8a1-591edb0d143a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:41.499043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4a4ad-f3d6-48d3-9ff9-429ea30a3cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:41.500105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4a4ad-f3d6-48d3-9ff9-429ea30a3cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:41.500579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4a4ad-f3d6-48d3-9ff9-429ea30a3cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:41.501037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4a4ad-f3d6-48d3-9ff9-429ea30a3cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:41.501873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4a4ad-f3d6-48d3-9ff9-429ea30a3cb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:41.502357 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4a4ad-f3d6-48d3-9ff9-429ea30a3cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:41.503921 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4a4ad-f3d6-48d3-9ff9-429ea30a3cb6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:41.512782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 273/545] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:41.518663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f2286-bf54-4723-83a4-8fb39331c05d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:41.625186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:41.642718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f2286-bf54-4723-83a4-8fb39331c05d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:41.682645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f466-58c9-490e-874a-f3a59e6732d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:41.683312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f466-58c9-490e-874a-f3a59e6732d7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:41.683648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f466-58c9-490e-874a-f3a59e6732d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:41.683927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f466-58c9-490e-874a-f3a59e6732d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:41.698705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f466-58c9-490e-874a-f3a59e6732d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:41.698705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f466-58c9-490e-874a-f3a59e6732d7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7845f466-58c9-490e-874a-f3a59e6732d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:41.713744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:41.714646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:41.715531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:41.715531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:41.715531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:41.715531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 273/546] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:41.723881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4a4ad-f3d6-48d3-9ff9-429ea30a3cb6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:41.845010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:41.848409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4a4ad-f3d6-48d3-9ff9-429ea30a3cb6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:41.882300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f7e5d-5026-4dd5-beaf-a600f426c66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:41.882938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f7e5d-5026-4dd5-beaf-a600f426c66d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:41.883218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f7e5d-5026-4dd5-beaf-a600f426c66d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:41.883486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f7e5d-5026-4dd5-beaf-a600f426c66d None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:41.884128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f7e5d-5026-4dd5-beaf-a600f426c66d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:41.884421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f7e5d-5026-4dd5-beaf-a600f426c66d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:41.885778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f7e5d-5026-4dd5-beaf-a600f426c66d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:41.902771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 274/547] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:41.904153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f466-58c9-490e-874a-f3a59e6732d7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:42.050581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f466-58c9-490e-874a-f3a59e6732d7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:42.081151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:42.086296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b07b8-6283-4fdc-84c7-4b005d20cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:42.087155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b07b8-6283-4fdc-84c7-4b005d20cf29 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:42.087495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b07b8-6283-4fdc-84c7-4b005d20cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:42.087928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b07b8-6283-4fdc-84c7-4b005d20cf29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:42.095734 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b07b8-6283-4fdc-84c7-4b005d20cf29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:42.097472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b07b8-6283-4fdc-84c7-4b005d20cf29 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-455b07b8-6283-4fdc-84c7-4b005d20cf29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:42.109416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:42.110347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:42.112213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 274/548] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:21:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:42.118818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f7e5d-5026-4dd5-beaf-a600f426c66d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:42.187639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb2ab-c56c-4c38-88c6-8333926fa6bc None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:42.187915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb2ab-c56c-4c38-88c6-8333926fa6bc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:42.188183 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb2ab-c56c-4c38-88c6-8333926fa6bc None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:42.189523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 275/549] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:42.194473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40507-c5b1-4c54-b756-01f890fe15b7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:42.194992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40507-c5b1-4c54-b756-01f890fe15b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:42.195463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40507-c5b1-4c54-b756-01f890fe15b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:42.230026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c3b40507-c5b1-4c54-b756-01f890fe15b7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:42.231254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3b40507-c5b1-4c54-b756-01f890fe15b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:42.276719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f7e5d-5026-4dd5-beaf-a600f426c66d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:42.321306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ae3af-4e52-4004-8f91-9050f0cea53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:42.321833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ae3af-4e52-4004-8f91-9050f0cea53e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:42.322114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ae3af-4e52-4004-8f91-9050f0cea53e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:42.322389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ae3af-4e52-4004-8f91-9050f0cea53e None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:42.323307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ae3af-4e52-4004-8f91-9050f0cea53e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:42.323617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ae3af-4e52-4004-8f91-9050f0cea53e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:42.325073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ae3af-4e52-4004-8f91-9050f0cea53e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:42.363311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 275/550] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 31 11:21:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:42.368295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ae3af-4e52-4004-8f91-9050f0cea53e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:42.387856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 276/551] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:42.396359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:42.481775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ae3af-4e52-4004-8f91-9050f0cea53e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:42.519993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6014f19-d934-4db1-8a09-3dc0205c50fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:42.520601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6014f19-d934-4db1-8a09-3dc0205c50fc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:42.520880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6014f19-d934-4db1-8a09-3dc0205c50fc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:42.521150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6014f19-d934-4db1-8a09-3dc0205c50fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:42.592035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6014f19-d934-4db1-8a09-3dc0205c50fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:42.593526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6014f19-d934-4db1-8a09-3dc0205c50fc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:42.612615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:42.710537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 276/552] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:42.719971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b40507-c5b1-4c54-b756-01f890fe15b7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:42.842582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b40507-c5b1-4c54-b756-01f890fe15b7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:42.866647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:42.879063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97873e30-a256-4060-8042-0f0ac1c8ecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:42.879765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97873e30-a256-4060-8042-0f0ac1c8ecd5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:42.880201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97873e30-a256-4060-8042-0f0ac1c8ecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:42.880394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6014f19-d934-4db1-8a09-3dc0205c50fc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:42.880566 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97873e30-a256-4060-8042-0f0ac1c8ecd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:42.891882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97873e30-a256-4060-8042-0f0ac1c8ecd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:42.893485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97873e30-a256-4060-8042-0f0ac1c8ecd5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-97873e30-a256-4060-8042-0f0ac1c8ecd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:42.908759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:42.909818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:42.910872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:42.910872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:42.910872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:42.910872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 277/553] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:42.922657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97873e30-a256-4060-8042-0f0ac1c8ecd5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.032789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97873e30-a256-4060-8042-0f0ac1c8ecd5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.052213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6014f19-d934-4db1-8a09-3dc0205c50fc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.069316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ab673-0cc4-441f-8417-ca89fa3d8013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.070038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ab673-0cc4-441f-8417-ca89fa3d8013 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.070318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ab673-0cc4-441f-8417-ca89fa3d8013 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.070854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:43.071233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ab673-0cc4-441f-8417-ca89fa3d8013 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.071887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ab673-0cc4-441f-8417-ca89fa3d8013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:43.072190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ab673-0cc4-441f-8417-ca89fa3d8013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.073669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ab673-0cc4-441f-8417-ca89fa3d8013 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.088469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 278/554] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:43.089942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e483e2-8e91-49d4-8d50-b0a1fcac9aa5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.090225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e483e2-8e91-49d4-8d50-b0a1fcac9aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.090396 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edad19-627a-4c51-93f5-bd6a6817a514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.090507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e483e2-8e91-49d4-8d50-b0a1fcac9aa5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.091036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edad19-627a-4c51-93f5-bd6a6817a514 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.091318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edad19-627a-4c51-93f5-bd6a6817a514 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.091595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edad19-627a-4c51-93f5-bd6a6817a514 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.091949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 279/555] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:43.096880 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e483e2-8e91-49d4-8d50-b0a1fcac9aa5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.109101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edad19-627a-4c51-93f5-bd6a6817a514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-b8edad19-627a-4c51-93f5-bd6a6817a514 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:43.116301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:43.117280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:43.118080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:43.119373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 277/556] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:43.122726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100541-f580-48dc-9565-b50533aeb28e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.122726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100541-f580-48dc-9565-b50533aeb28e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.122726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100541-f580-48dc-9565-b50533aeb28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.142040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:43.143423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-82100541-f580-48dc-9565-b50533aeb28e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:43.145408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-82100541-f580-48dc-9565-b50533aeb28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:43.213447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e483e2-8e91-49d4-8d50-b0a1fcac9aa5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.226865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 278/557] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:43.228077 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100541-f580-48dc-9565-b50533aeb28e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.260601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b285317-6994-4794-b5b2-a0fb2fe8cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.261262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285317-6994-4794-b5b2-a0fb2fe8cfee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.261543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285317-6994-4794-b5b2-a0fb2fe8cfee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.261815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285317-6994-4794-b5b2-a0fb2fe8cfee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.270628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b285317-6994-4794-b5b2-a0fb2fe8cfee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.272712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b285317-6994-4794-b5b2-a0fb2fe8cfee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4b285317-6994-4794-b5b2-a0fb2fe8cfee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:43.288169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:43.289592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:43.290460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:43.290460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:43.290460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:43.290460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:43.290460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:43.290460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:43.290460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:43.290460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:43.290922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 280/558] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:43.291852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004fab9-1b35-4aba-ad42-2a6596ee1a8f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.292135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004fab9-1b35-4aba-ad42-2a6596ee1a8f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.292407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004fab9-1b35-4aba-ad42-2a6596ee1a8f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.294782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 281/559] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:43.296972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004fab9-1b35-4aba-ad42-2a6596ee1a8f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.348658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100541-f580-48dc-9565-b50533aeb28e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.359172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:43.386932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa79885-ec36-4c30-a97f-01ce1b64de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.387569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa79885-ec36-4c30-a97f-01ce1b64de20 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.387803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa79885-ec36-4c30-a97f-01ce1b64de20 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.388078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa79885-ec36-4c30-a97f-01ce1b64de20 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.388778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa79885-ec36-4c30-a97f-01ce1b64de20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:43.389042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa79885-ec36-4c30-a97f-01ce1b64de20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.391072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa79885-ec36-4c30-a97f-01ce1b64de20 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.399831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 279/560] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:43.401074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be535-d816-4053-9f04-ed1f8baa72bc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.401357 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be535-d816-4053-9f04-ed1f8baa72bc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.401632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be535-d816-4053-9f04-ed1f8baa72bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.419902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-dd0be535-d816-4053-9f04-ed1f8baa72bc None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:43.421193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dd0be535-d816-4053-9f04-ed1f8baa72bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:43.433063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:43.443242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004fab9-1b35-4aba-ad42-2a6596ee1a8f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.494160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a826c-7e70-473a-8360-51739efeb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.495264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a826c-7e70-473a-8360-51739efeb1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.495747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a826c-7e70-473a-8360-51739efeb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.496737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a826c-7e70-473a-8360-51739efeb1c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.497784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a826c-7e70-473a-8360-51739efeb1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:43.498395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a826c-7e70-473a-8360-51739efeb1c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.501376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a826c-7e70-473a-8360-51739efeb1c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.510792 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 280/561] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:43.515079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be535-d816-4053-9f04-ed1f8baa72bc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.517615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 282/562] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:43.518719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a826c-7e70-473a-8360-51739efeb1c4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.617221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:43.620820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be535-d816-4053-9f04-ed1f8baa72bc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.625776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a826c-7e70-473a-8360-51739efeb1c4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.658838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674fcf-2877-4158-bf58-7cd9e3bbc4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.659612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674fcf-2877-4158-bf58-7cd9e3bbc4ce None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.659930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674fcf-2877-4158-bf58-7cd9e3bbc4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.660206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674fcf-2877-4158-bf58-7cd9e3bbc4ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.664536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b9429-111f-4472-96ee-cf61e44005c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.665395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b9429-111f-4472-96ee-cf61e44005c9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.671018 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52674fcf-2877-4158-bf58-7cd9e3bbc4ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.671455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b9429-111f-4472-96ee-cf61e44005c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.671952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b9429-111f-4472-96ee-cf61e44005c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.672625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52674fcf-2877-4158-bf58-7cd9e3bbc4ce None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.683733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b9429-111f-4472-96ee-cf61e44005c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-52674fcf-2877-4158-bf58-7cd9e3bbc4ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:43.688269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:43.690584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:43.692933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:43.692933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:43.692933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-227b9429-111f-4472-96ee-cf61e44005c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:43.693324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:43.699827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:43.700832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:43.701599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 281/563] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:43.701599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674fcf-2877-4158-bf58-7cd9e3bbc4ce None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.701750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 283/564] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:43.701750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5debf2b-5670-439f-9a33-2e96d616063a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.701750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5debf2b-5670-439f-9a33-2e96d616063a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.701750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5debf2b-5670-439f-9a33-2e96d616063a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.701750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 284/565] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:43.706675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5debf2b-5670-439f-9a33-2e96d616063a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.720725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:43.803827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674fcf-2877-4158-bf58-7cd9e3bbc4ce None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.819803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5debf2b-5670-439f-9a33-2e96d616063a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.837174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37268827-ebce-4506-a547-0a16fee96883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.837771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37268827-ebce-4506-a547-0a16fee96883 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.838051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37268827-ebce-4506-a547-0a16fee96883 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.838322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37268827-ebce-4506-a547-0a16fee96883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.839083 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37268827-ebce-4506-a547-0a16fee96883 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=a1966d24e4cf4a46b71dc2ec302a8d27) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:43.839392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37268827-ebce-4506-a547-0a16fee96883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.840822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37268827-ebce-4506-a547-0a16fee96883 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.846092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 282/566] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/role_assignments?user.id=a1966d24e4cf4a46b71dc2ec302a8d27&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:43.847163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37268827-ebce-4506-a547-0a16fee96883 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.854224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b66f7-e635-4a5f-aaf3-af1d165eb50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.854893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b66f7-e635-4a5f-aaf3-af1d165eb50a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.855176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b66f7-e635-4a5f-aaf3-af1d165eb50a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.855447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b66f7-e635-4a5f-aaf3-af1d165eb50a None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.856130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b66f7-e635-4a5f-aaf3-af1d165eb50a None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:43.856432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b66f7-e635-4a5f-aaf3-af1d165eb50a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.857855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b66f7-e635-4a5f-aaf3-af1d165eb50a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.867731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 285/567] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:43.868951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec961-ccd6-4c16-b8d8-3b5b80c8a02b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.869237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec961-ccd6-4c16-b8d8-3b5b80c8a02b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.869509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec961-ccd6-4c16-b8d8-3b5b80c8a02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.883356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:43.892959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e5aec961-ccd6-4c16-b8d8-3b5b80c8a02b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:43.894227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e5aec961-ccd6-4c16-b8d8-3b5b80c8a02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:43.970742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 286/568] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:43.970742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aec961-ccd6-4c16-b8d8-3b5b80c8a02b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.982061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37268827-ebce-4506-a547-0a16fee96883 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.992850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:44.033302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d746-5fb2-44c1-970a-d985f0f4dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.033914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d746-5fb2-44c1-970a-d985f0f4dc1a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.034190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d746-5fb2-44c1-970a-d985f0f4dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.034460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d746-5fb2-44c1-970a-d985f0f4dc1a None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.035291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d746-5fb2-44c1-970a-d985f0f4dc1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:44.035967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d746-5fb2-44c1-970a-d985f0f4dc1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.037575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d746-5fb2-44c1-970a-d985f0f4dc1a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.052263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 283/569] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:44.053103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d746-5fb2-44c1-970a-d985f0f4dc1a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.112110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aec961-ccd6-4c16-b8d8-3b5b80c8a02b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.148025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:44.164990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d6040-dd3f-4213-bf37-90c3d0d25b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.165933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d6040-dd3f-4213-bf37-90c3d0d25b26 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.166208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d6040-dd3f-4213-bf37-90c3d0d25b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.166775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d6040-dd3f-4213-bf37-90c3d0d25b26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.173999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d746-5fb2-44c1-970a-d985f0f4dc1a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.181154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d6040-dd3f-4213-bf37-90c3d0d25b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-704d6040-dd3f-4213-bf37-90c3d0d25b26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:44.188604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:44.189525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:44.190340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:44.191009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 287/570] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:44.194706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d6040-dd3f-4213-bf37-90c3d0d25b26 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.210945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c695eb-2371-4235-893c-828d317d755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.211730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c695eb-2371-4235-893c-828d317d755c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.212016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c695eb-2371-4235-893c-828d317d755c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.212428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c695eb-2371-4235-893c-828d317d755c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.224526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c695eb-2371-4235-893c-828d317d755c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.226259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c695eb-2371-4235-893c-828d317d755c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-b4c695eb-2371-4235-893c-828d317d755c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:44.242976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:44.245141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:44.247272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:44.247272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:44.247272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:44.247272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 284/571] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:44.247272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c695eb-2371-4235-893c-828d317d755c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.262891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:44.300475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d6040-dd3f-4213-bf37-90c3d0d25b26 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.339692 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d629-a64c-4b0b-aff9-f2079b5a8872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.340318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d629-a64c-4b0b-aff9-f2079b5a8872 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.340597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d629-a64c-4b0b-aff9-f2079b5a8872 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.340870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d629-a64c-4b0b-aff9-f2079b5a8872 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.348511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13d629-a64c-4b0b-aff9-f2079b5a8872 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.350048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13d629-a64c-4b0b-aff9-f2079b5a8872 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.358913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c695eb-2371-4235-893c-828d317d755c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ba13d629-a64c-4b0b-aff9-f2079b5a8872 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:44.363824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:44.364791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:44.365725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 288/572] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:44.366411 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d629-a64c-4b0b-aff9-f2079b5a8872 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.390009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:44.399161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb2798-f671-4430-a636-d5fdc5998ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.399698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb2798-f671-4430-a636-d5fdc5998ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.399979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb2798-f671-4430-a636-d5fdc5998ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.400250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb2798-f671-4430-a636-d5fdc5998ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.400905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb2798-f671-4430-a636-d5fdc5998ee4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:44.401199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb2798-f671-4430-a636-d5fdc5998ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.402558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb2798-f671-4430-a636-d5fdc5998ee4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.410372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 285/573] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:44.411197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb2798-f671-4430-a636-d5fdc5998ee4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.479493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d629-a64c-4b0b-aff9-f2079b5a8872 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.506407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:44.517157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130dc77-3886-4675-b22a-add9edd3f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.517852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130dc77-3886-4675-b22a-add9edd3f87f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.518139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130dc77-3886-4675-b22a-add9edd3f87f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.518411 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130dc77-3886-4675-b22a-add9edd3f87f None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.518510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb2798-f671-4430-a636-d5fdc5998ee4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.519087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130dc77-3886-4675-b22a-add9edd3f87f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:44.519389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130dc77-3886-4675-b22a-add9edd3f87f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.520803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130dc77-3886-4675-b22a-add9edd3f87f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.539366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 289/574] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:44.540280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130dc77-3886-4675-b22a-add9edd3f87f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.559395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd38767-5645-4c98-a763-9c31a6e7b962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.560016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd38767-5645-4c98-a763-9c31a6e7b962 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.560290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd38767-5645-4c98-a763-9c31a6e7b962 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.560660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd38767-5645-4c98-a763-9c31a6e7b962 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.571288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd38767-5645-4c98-a763-9c31a6e7b962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-dfd38767-5645-4c98-a763-9c31a6e7b962 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:44.576610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:44.578715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 286/575] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:44.579625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd38767-5645-4c98-a763-9c31a6e7b962 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.632746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:44.656594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130dc77-3886-4675-b22a-add9edd3f87f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.689277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd38767-5645-4c98-a763-9c31a6e7b962 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.695419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f469-230a-4c98-866d-f8301f88dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.696028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f469-230a-4c98-866d-f8301f88dc4b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.696541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f469-230a-4c98-866d-f8301f88dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.696884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f469-230a-4c98-866d-f8301f88dc4b None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.697688 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39f469-230a-4c98-866d-f8301f88dc4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:44.698067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39f469-230a-4c98-866d-f8301f88dc4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.699607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39f469-230a-4c98-866d-f8301f88dc4b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.722938 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 290/576] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:44.722938 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f469-230a-4c98-866d-f8301f88dc4b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.739401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223f04-8b1b-4cfb-9135-4cd5ca2e2294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.740170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223f04-8b1b-4cfb-9135-4cd5ca2e2294 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.740554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223f04-8b1b-4cfb-9135-4cd5ca2e2294 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.740929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223f04-8b1b-4cfb-9135-4cd5ca2e2294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.753474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7223f04-8b1b-4cfb-9135-4cd5ca2e2294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.755245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7223f04-8b1b-4cfb-9135-4cd5ca2e2294 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.765989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e7223f04-8b1b-4cfb-9135-4cd5ca2e2294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:44.771886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:44.772975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:44.774037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:44.774037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:44.774037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:44.775299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 287/577] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:44.780460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223f04-8b1b-4cfb-9135-4cd5ca2e2294 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.823145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f469-230a-4c98-866d-f8301f88dc4b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.857895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b91e8-17a1-4659-91ca-f41be4ca259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.858515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b91e8-17a1-4659-91ca-f41be4ca259d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.858864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b91e8-17a1-4659-91ca-f41be4ca259d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.859172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b91e8-17a1-4659-91ca-f41be4ca259d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.866302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b91e8-17a1-4659-91ca-f41be4ca259d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.867766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b91e8-17a1-4659-91ca-f41be4ca259d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b74b91e8-17a1-4659-91ca-f41be4ca259d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:44.879861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:44.880844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 291/578] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:44.881802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b91e8-17a1-4659-91ca-f41be4ca259d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.891558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223f04-8b1b-4cfb-9135-4cd5ca2e2294 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.893247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:44.930242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f00de4-22a5-46da-a115-14db581d01c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.930945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f00de4-22a5-46da-a115-14db581d01c7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.931336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f00de4-22a5-46da-a115-14db581d01c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.931716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f00de4-22a5-46da-a115-14db581d01c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.932480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f00de4-22a5-46da-a115-14db581d01c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:44.932883 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f00de4-22a5-46da-a115-14db581d01c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.934382 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f00de4-22a5-46da-a115-14db581d01c7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.947740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 288/579] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:44.947740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f00de4-22a5-46da-a115-14db581d01c7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.003993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b91e8-17a1-4659-91ca-f41be4ca259d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.007179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.041123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e51eb-3424-4426-a01b-9ed5c3f03aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.041741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e51eb-3424-4426-a01b-9ed5c3f03aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.042028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e51eb-3424-4426-a01b-9ed5c3f03aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.042307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e51eb-3424-4426-a01b-9ed5c3f03aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.054495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e51eb-3424-4426-a01b-9ed5c3f03aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.055306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f00de4-22a5-46da-a115-14db581d01c7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.056005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e51eb-3424-4426-a01b-9ed5c3f03aa8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8c9e51eb-3424-4426-a01b-9ed5c3f03aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:45.070929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:45.072091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:45.072986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:45.072986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:45.072986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:45.072986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 292/580] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:45.073301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e51eb-3424-4426-a01b-9ed5c3f03aa8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.102874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b67c3-3c50-4988-8bb0-2509643c3a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.103939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b67c3-3c50-4988-8bb0-2509643c3a7e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.104802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b67c3-3c50-4988-8bb0-2509643c3a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.105232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b67c3-3c50-4988-8bb0-2509643c3a7e None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.106290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b67c3-3c50-4988-8bb0-2509643c3a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:45.107027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b67c3-3c50-4988-8bb0-2509643c3a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.109803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b67c3-3c50-4988-8bb0-2509643c3a7e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.125071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 289/581] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:45.126294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b67c3-3c50-4988-8bb0-2509643c3a7e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.154741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.182880 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e51eb-3424-4426-a01b-9ed5c3f03aa8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.219802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30ac4c-da7b-4df7-b2cd-252c8c5ac0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.220462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ac4c-da7b-4df7-b2cd-252c8c5ac0bf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.220978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ac4c-da7b-4df7-b2cd-252c8c5ac0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.221105 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ac4c-da7b-4df7-b2cd-252c8c5ac0bf None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.222141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30ac4c-da7b-4df7-b2cd-252c8c5ac0bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:45.222415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30ac4c-da7b-4df7-b2cd-252c8c5ac0bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.223920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30ac4c-da7b-4df7-b2cd-252c8c5ac0bf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.234224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b67c3-3c50-4988-8bb0-2509643c3a7e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.242599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 293/582] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:45.243665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30ac4c-da7b-4df7-b2cd-252c8c5ac0bf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.260609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.274404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda4f0-c746-4506-b560-71880bfc4dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.275135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda4f0-c746-4506-b560-71880bfc4dbe None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.275370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda4f0-c746-4506-b560-71880bfc4dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.275618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda4f0-c746-4506-b560-71880bfc4dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.286698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efda4f0-c746-4506-b560-71880bfc4dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.288175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efda4f0-c746-4506-b560-71880bfc4dbe None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7efda4f0-c746-4506-b560-71880bfc4dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:45.303787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:45.304799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:45.305690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:45.305690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:45.305690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:45.305690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 290/583] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:45.305690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda4f0-c746-4506-b560-71880bfc4dbe None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.353866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30ac4c-da7b-4df7-b2cd-252c8c5ac0bf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.388471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.390477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ba35-3fcc-417d-aa5a-05b19c87e4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.391145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ba35-3fcc-417d-aa5a-05b19c87e4bd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.391446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ba35-3fcc-417d-aa5a-05b19c87e4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.391715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ba35-3fcc-417d-aa5a-05b19c87e4bd None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.392386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03ba35-3fcc-417d-aa5a-05b19c87e4bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:45.392732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03ba35-3fcc-417d-aa5a-05b19c87e4bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.394092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03ba35-3fcc-417d-aa5a-05b19c87e4bd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.406385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 294/584] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:45.411531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ba35-3fcc-417d-aa5a-05b19c87e4bd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.413622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda4f0-c746-4506-b560-71880bfc4dbe None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.449394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05ba80-ccde-4e91-873f-5ec11f0b85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.449944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05ba80-ccde-4e91-873f-5ec11f0b85ad None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.450225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05ba80-ccde-4e91-873f-5ec11f0b85ad None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.450498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05ba80-ccde-4e91-873f-5ec11f0b85ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.459393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05ba80-ccde-4e91-873f-5ec11f0b85ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.460823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05ba80-ccde-4e91-873f-5ec11f0b85ad None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-cb05ba80-ccde-4e91-873f-5ec11f0b85ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:45.473636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:45.474605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 291/585] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:45.475588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05ba80-ccde-4e91-873f-5ec11f0b85ad None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.495713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.525034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ba35-3fcc-417d-aa5a-05b19c87e4bd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.559223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b26b-6eb3-42be-95c7-f3cf16766906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.559857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b26b-6eb3-42be-95c7-f3cf16766906 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.560138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b26b-6eb3-42be-95c7-f3cf16766906 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.560413 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b26b-6eb3-42be-95c7-f3cf16766906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.571937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b26b-6eb3-42be-95c7-f3cf16766906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.573630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b26b-6eb3-42be-95c7-f3cf16766906 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.581322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05ba80-ccde-4e91-873f-5ec11f0b85ad None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ab16b26b-6eb3-42be-95c7-f3cf16766906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:45.588184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:45.589110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:45.590541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:45.590541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:45.590541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:45.590541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 295/586] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:45.590541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b26b-6eb3-42be-95c7-f3cf16766906 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.621777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b4c2c-e5ef-4452-8785-6535c3ff040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.622388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b4c2c-e5ef-4452-8785-6535c3ff040e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.622670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b4c2c-e5ef-4452-8785-6535c3ff040e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.623017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b4c2c-e5ef-4452-8785-6535c3ff040e None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.623666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b4c2c-e5ef-4452-8785-6535c3ff040e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:45.624629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b4c2c-e5ef-4452-8785-6535c3ff040e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.626003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b4c2c-e5ef-4452-8785-6535c3ff040e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.628929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.644230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 292/587] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:45.644230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b4c2c-e5ef-4452-8785-6535c3ff040e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.709245 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b26b-6eb3-42be-95c7-f3cf16766906 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.737502 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.746448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b4c2c-e5ef-4452-8785-6535c3ff040e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.747817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267582e8-6a77-4939-8fd3-6c4eb0f356f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.748619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267582e8-6a77-4939-8fd3-6c4eb0f356f5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.749636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267582e8-6a77-4939-8fd3-6c4eb0f356f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.749910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267582e8-6a77-4939-8fd3-6c4eb0f356f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.756924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267582e8-6a77-4939-8fd3-6c4eb0f356f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.758390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267582e8-6a77-4939-8fd3-6c4eb0f356f5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-267582e8-6a77-4939-8fd3-6c4eb0f356f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:45.769997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:45.770980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:45.771862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:45.771862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:45.771862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:45.771862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:45.771862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:45.771862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:45.771862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:45.771862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:45.771862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 296/588] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:45.772427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267582e8-6a77-4939-8fd3-6c4eb0f356f5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.789084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118c7ca-c7df-4650-ac7f-3878f43dfb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.789816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118c7ca-c7df-4650-ac7f-3878f43dfb06 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.790103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118c7ca-c7df-4650-ac7f-3878f43dfb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.790371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118c7ca-c7df-4650-ac7f-3878f43dfb06 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.791134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118c7ca-c7df-4650-ac7f-3878f43dfb06 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:45.791439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118c7ca-c7df-4650-ac7f-3878f43dfb06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.792877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118c7ca-c7df-4650-ac7f-3878f43dfb06 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.813073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 293/589] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:45.813922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118c7ca-c7df-4650-ac7f-3878f43dfb06 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.866853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.884715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267582e8-6a77-4939-8fd3-6c4eb0f356f5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.911898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118c7ca-c7df-4650-ac7f-3878f43dfb06 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.917122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea3269-3206-4be0-b426-6e25ed8ba836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.917725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea3269-3206-4be0-b426-6e25ed8ba836 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.918008 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea3269-3206-4be0-b426-6e25ed8ba836 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.918284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea3269-3206-4be0-b426-6e25ed8ba836 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.918979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea3269-3206-4be0-b426-6e25ed8ba836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:45.919281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea3269-3206-4be0-b426-6e25ed8ba836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.921610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea3269-3206-4be0-b426-6e25ed8ba836 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.932885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 297/590] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:45.933592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea3269-3206-4be0-b426-6e25ed8ba836 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.950115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e22d5f-66d5-4efc-b8f5-ba23331eb2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.950775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22d5f-66d5-4efc-b8f5-ba23331eb2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.951054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22d5f-66d5-4efc-b8f5-ba23331eb2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.951324 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22d5f-66d5-4efc-b8f5-ba23331eb2a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.958272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e22d5f-66d5-4efc-b8f5-ba23331eb2a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.959781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e22d5f-66d5-4efc-b8f5-ba23331eb2a5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c4e22d5f-66d5-4efc-b8f5-ba23331eb2a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:45.970971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:45.972168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 294/591] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:45.973093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e22d5f-66d5-4efc-b8f5-ba23331eb2a5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.982583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.036919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea3269-3206-4be0-b426-6e25ed8ba836 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.070517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c110561-9c9e-4dd4-bfa7-78315f46a9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.071148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c110561-9c9e-4dd4-bfa7-78315f46a9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.071426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c110561-9c9e-4dd4-bfa7-78315f46a9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.071696 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c110561-9c9e-4dd4-bfa7-78315f46a9b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.071794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e22d5f-66d5-4efc-b8f5-ba23331eb2a5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.072392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c110561-9c9e-4dd4-bfa7-78315f46a9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:46.072698 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c110561-9c9e-4dd4-bfa7-78315f46a9b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.074128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c110561-9c9e-4dd4-bfa7-78315f46a9b3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.084746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.090529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 298/592] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:46.090529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292313-5811-43af-bab2-dd29c2aebf52 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.090529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292313-5811-43af-bab2-dd29c2aebf52 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.090529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292313-5811-43af-bab2-dd29c2aebf52 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.090529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 299/593] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:46.090529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0292313-5811-43af-bab2-dd29c2aebf52 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.107604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7fdf-951d-4983-abf2-0aa5f8bf239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.108915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7fdf-951d-4983-abf2-0aa5f8bf239a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.109199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7fdf-951d-4983-abf2-0aa5f8bf239a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.109471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7fdf-951d-4983-abf2-0aa5f8bf239a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.119681 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7fdf-951d-4983-abf2-0aa5f8bf239a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.121118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7fdf-951d-4983-abf2-0aa5f8bf239a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8fcd7fdf-951d-4983-abf2-0aa5f8bf239a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:46.134927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:46.135856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:46.136894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:46.136894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:46.136894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:46.136894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 295/594] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:46.136894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7fdf-951d-4983-abf2-0aa5f8bf239a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.195654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0292313-5811-43af-bab2-dd29c2aebf52 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.203464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.231396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545473f-ecaa-41db-90e0-72a4524f9b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.232071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545473f-ecaa-41db-90e0-72a4524f9b09 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.232353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545473f-ecaa-41db-90e0-72a4524f9b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.232627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545473f-ecaa-41db-90e0-72a4524f9b09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.235782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7fdf-951d-4983-abf2-0aa5f8bf239a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.239548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545473f-ecaa-41db-90e0-72a4524f9b09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.241001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545473f-ecaa-41db-90e0-72a4524f9b09 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1545473f-ecaa-41db-90e0-72a4524f9b09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:46.252677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:46.253563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:46.254445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:46.254445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:46.254445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:46.254445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:46.254445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:46.254445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:46.254445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:46.254445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:46.254445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 300/595] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:46.255511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545473f-ecaa-41db-90e0-72a4524f9b09 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.272877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767447f-aa84-4aca-8f77-18b6f8678ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.273479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767447f-aa84-4aca-8f77-18b6f8678ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.273753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767447f-aa84-4aca-8f77-18b6f8678ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.274030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767447f-aa84-4aca-8f77-18b6f8678ab4 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.274786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767447f-aa84-4aca-8f77-18b6f8678ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:46.275094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767447f-aa84-4aca-8f77-18b6f8678ab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.276523 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767447f-aa84-4aca-8f77-18b6f8678ab4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.293236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 296/596] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:46.294395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccfb10-2f35-488d-b35b-b3eb6e5f668e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.294695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccfb10-2f35-488d-b35b-b3eb6e5f668e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.294981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccfb10-2f35-488d-b35b-b3eb6e5f668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.320118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-62ccfb10-2f35-488d-b35b-b3eb6e5f668e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:46.321317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-62ccfb10-2f35-488d-b35b-b3eb6e5f668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:46.342406 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.357518 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545473f-ecaa-41db-90e0-72a4524f9b09 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.391382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bc4a8-9708-4777-bcf2-ba7f64a05ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.392030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bc4a8-9708-4777-bcf2-ba7f64a05ea7 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.392307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bc4a8-9708-4777-bcf2-ba7f64a05ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.392577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bc4a8-9708-4777-bcf2-ba7f64a05ea7 None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/bb50ee2f9ccd4a258f3396074db66e74/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.393642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 297/597] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:46.394463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccfb10-2f35-488d-b35b-b3eb6e5f668e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.406883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bc4a8-9708-4777-bcf2-ba7f64a05ea7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=bb50ee2f9ccd4a258f3396074db66e74, role_id=2c1fea0d72b84ff7b73cb582f4cf3a9e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.408332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bc4a8-9708-4777-bcf2-ba7f64a05ea7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.422831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 301/598] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:21:46 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/bb50ee2f9ccd4a258f3396074db66e74/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:46.423918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bc4a8-9708-4777-bcf2-ba7f64a05ea7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.452715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.537894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccfb10-2f35-488d-b35b-b3eb6e5f668e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.549698 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bc4a8-9708-4777-bcf2-ba7f64a05ea7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.576637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288c928-5f1e-4a07-aa1e-12ddcabc0b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.578249 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288c928-5f1e-4a07-aa1e-12ddcabc0b4d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.578754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288c928-5f1e-4a07-aa1e-12ddcabc0b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.579246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288c928-5f1e-4a07-aa1e-12ddcabc0b4d None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.580108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288c928-5f1e-4a07-aa1e-12ddcabc0b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:46.580609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288c928-5f1e-4a07-aa1e-12ddcabc0b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.582229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288c928-5f1e-4a07-aa1e-12ddcabc0b4d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.586962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20776b4e-f0a0-46eb-9ddf-c31ac28471ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.587578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20776b4e-f0a0-46eb-9ddf-c31ac28471ff None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.587857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20776b4e-f0a0-46eb-9ddf-c31ac28471ff None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.588127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20776b4e-f0a0-46eb-9ddf-c31ac28471ff None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.588827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20776b4e-f0a0-46eb-9ddf-c31ac28471ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:46.589130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20776b4e-f0a0-46eb-9ddf-c31ac28471ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.590590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20776b4e-f0a0-46eb-9ddf-c31ac28471ff None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.599402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 298/599] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:46.600556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288c928-5f1e-4a07-aa1e-12ddcabc0b4d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.609552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 302/600] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:46.610534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20776b4e-f0a0-46eb-9ddf-c31ac28471ff None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.622343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.720289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288c928-5f1e-4a07-aa1e-12ddcabc0b4d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.724593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.750572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20776b4e-f0a0-46eb-9ddf-c31ac28471ff None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.758999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265df2a-2ee4-452f-89ac-0f17483f1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.759619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265df2a-2ee4-452f-89ac-0f17483f1d81 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.759901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265df2a-2ee4-452f-89ac-0f17483f1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.760171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265df2a-2ee4-452f-89ac-0f17483f1d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.771092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265df2a-2ee4-452f-89ac-0f17483f1d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.772533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265df2a-2ee4-452f-89ac-0f17483f1d81 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-9265df2a-2ee4-452f-89ac-0f17483f1d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:46.787261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:46.788345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:46.789877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:46.789877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:46.789877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:46.790061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f2486-eef0-4278-9be3-94038226fcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.790061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f2486-eef0-4278-9be3-94038226fcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.790061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f2486-eef0-4278-9be3-94038226fcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.790061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f2486-eef0-4278-9be3-94038226fcb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.790330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 299/601] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:46.790330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265df2a-2ee4-452f-89ac-0f17483f1d81 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.801294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f2486-eef0-4278-9be3-94038226fcb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.802780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f2486-eef0-4278-9be3-94038226fcb7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c77f2486-eef0-4278-9be3-94038226fcb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:46.815380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:46.816290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:46.817206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:46.817206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:46.817206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:46.817206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:46.817206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:46.817206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:46.817206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:46.817206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:46.817206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 303/602] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:46.818290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f2486-eef0-4278-9be3-94038226fcb7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.865397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.901925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265df2a-2ee4-452f-89ac-0f17483f1d81 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.926441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f2486-eef0-4278-9be3-94038226fcb7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.937956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4e73e-f398-4b40-916f-d4c08b950131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.938605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4e73e-f398-4b40-916f-d4c08b950131 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.938909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4e73e-f398-4b40-916f-d4c08b950131 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.939181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4e73e-f398-4b40-916f-d4c08b950131 None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/76462c2e1ec447acbd2aba9e77ae00b1/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.953988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4e73e-f398-4b40-916f-d4c08b950131 None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=76462c2e1ec447acbd2aba9e77ae00b1, role_id=2c1fea0d72b84ff7b73cb582f4cf3a9e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.955673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4e73e-f398-4b40-916f-d4c08b950131 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.965570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb22e99-6a49-4213-ba7c-035198e6c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.966207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb22e99-6a49-4213-ba7c-035198e6c017 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.966491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb22e99-6a49-4213-ba7c-035198e6c017 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.966830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb22e99-6a49-4213-ba7c-035198e6c017 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.970042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.982717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 300/603] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:21:46 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/76462c2e1ec447acbd2aba9e77ae00b1/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:46.982717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4e73e-f398-4b40-916f-d4c08b950131 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.990066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb22e99-6a49-4213-ba7c-035198e6c017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bbb22e99-6a49-4213-ba7c-035198e6c017 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:46.995735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:46.996770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:46.997593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 304/604] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:46.998307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb22e99-6a49-4213-ba7c-035198e6c017 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.127793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb22e99-6a49-4213-ba7c-035198e6c017 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.136346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4e73e-f398-4b40-916f-d4c08b950131 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.157831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:47.170228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56bbaa-f73e-4626-ae31-269a6a3c074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.171888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56bbaa-f73e-4626-ae31-269a6a3c074c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.171888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56bbaa-f73e-4626-ae31-269a6a3c074c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.171888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56bbaa-f73e-4626-ae31-269a6a3c074c None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.172606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56bbaa-f73e-4626-ae31-269a6a3c074c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:47.172911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56bbaa-f73e-4626-ae31-269a6a3c074c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.174347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56bbaa-f73e-4626-ae31-269a6a3c074c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.187118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70809314-35c7-41b5-8ac1-17cc0a897d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.187819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70809314-35c7-41b5-8ac1-17cc0a897d84 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.187969 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 305/605] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:47.188138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70809314-35c7-41b5-8ac1-17cc0a897d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.188408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70809314-35c7-41b5-8ac1-17cc0a897d84 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.188817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56bbaa-f73e-4626-ae31-269a6a3c074c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.189234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70809314-35c7-41b5-8ac1-17cc0a897d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:47.189549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70809314-35c7-41b5-8ac1-17cc0a897d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.191019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70809314-35c7-41b5-8ac1-17cc0a897d84 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.209288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 301/606] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:47.210174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70809314-35c7-41b5-8ac1-17cc0a897d84 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.255136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:47.304107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56bbaa-f73e-4626-ae31-269a6a3c074c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.342593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17918255-d88e-418a-aca2-60ed7321cd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.343468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17918255-d88e-418a-aca2-60ed7321cd97 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.343818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17918255-d88e-418a-aca2-60ed7321cd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.344159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17918255-d88e-418a-aca2-60ed7321cd97 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.344902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17918255-d88e-418a-aca2-60ed7321cd97 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:47.345270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17918255-d88e-418a-aca2-60ed7321cd97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.347011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17918255-d88e-418a-aca2-60ed7321cd97 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.355384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70809314-35c7-41b5-8ac1-17cc0a897d84 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.356189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 306/607] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:47.357070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17918255-d88e-418a-aca2-60ed7321cd97 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.406483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467735a-fa63-4663-9cbf-e6868cc38b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.407216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467735a-fa63-4663-9cbf-e6868cc38b0d None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.407574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467735a-fa63-4663-9cbf-e6868cc38b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.407954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467735a-fa63-4663-9cbf-e6868cc38b0d None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/0f4db8824b7e4ae6880840e3c8680610/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.424082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467735a-fa63-4663-9cbf-e6868cc38b0d None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=0f4db8824b7e4ae6880840e3c8680610, role_id=2c1fea0d72b84ff7b73cb582f4cf3a9e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.425683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467735a-fa63-4663-9cbf-e6868cc38b0d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.443738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 302/608] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:21:47 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/0f4db8824b7e4ae6880840e3c8680610/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:47.444860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467735a-fa63-4663-9cbf-e6868cc38b0d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.478469 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:47.491974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17918255-d88e-418a-aca2-60ed7321cd97 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.514267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:47.539076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8303cf-5926-4943-94ac-8be1f2cfecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.540754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8303cf-5926-4943-94ac-8be1f2cfecc4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.541254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8303cf-5926-4943-94ac-8be1f2cfecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.541732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8303cf-5926-4943-94ac-8be1f2cfecc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.551733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8303cf-5926-4943-94ac-8be1f2cfecc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.553848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8303cf-5926-4943-94ac-8be1f2cfecc4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7c8303cf-5926-4943-94ac-8be1f2cfecc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:47.569382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:47.570426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:47.571365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:47.571365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:47.571365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:47.571365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:47.571365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:47.571365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:47.571365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:47.571365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:47.574195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 307/609] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:47.580757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8303cf-5926-4943-94ac-8be1f2cfecc4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.633897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467735a-fa63-4663-9cbf-e6868cc38b0d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.678956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836a8f2-2b05-4534-a886-41349f27edc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.679610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836a8f2-2b05-4534-a886-41349f27edc3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.680148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836a8f2-2b05-4534-a886-41349f27edc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.680430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836a8f2-2b05-4534-a886-41349f27edc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.700836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836a8f2-2b05-4534-a886-41349f27edc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.704139 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836a8f2-2b05-4534-a886-41349f27edc3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f836a8f2-2b05-4534-a886-41349f27edc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:47.723535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:47.724525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:47.726114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:47.726114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:47.726114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:47.726114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 303/610] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:47.731036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836a8f2-2b05-4534-a886-41349f27edc3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.738392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8303cf-5926-4943-94ac-8be1f2cfecc4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.773864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4515344-f9f9-490e-bf45-5ed823df4a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.774656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4515344-f9f9-490e-bf45-5ed823df4a39 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.774860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4515344-f9f9-490e-bf45-5ed823df4a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.775071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4515344-f9f9-490e-bf45-5ed823df4a39 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.775762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4515344-f9f9-490e-bf45-5ed823df4a39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:47.776062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4515344-f9f9-490e-bf45-5ed823df4a39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.777606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4515344-f9f9-490e-bf45-5ed823df4a39 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.791157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 308/611] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:47.804073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4515344-f9f9-490e-bf45-5ed823df4a39 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.821340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:47.847795 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836a8f2-2b05-4534-a886-41349f27edc3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.888030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703987a6-fda4-445f-ba0b-d63ed24814f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.888636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703987a6-fda4-445f-ba0b-d63ed24814f0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.888920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703987a6-fda4-445f-ba0b-d63ed24814f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.889197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703987a6-fda4-445f-ba0b-d63ed24814f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.890388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703987a6-fda4-445f-ba0b-d63ed24814f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:47.890706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703987a6-fda4-445f-ba0b-d63ed24814f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.892085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703987a6-fda4-445f-ba0b-d63ed24814f0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.898308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:47.920179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 304/612] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:47.926748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703987a6-fda4-445f-ba0b-d63ed24814f0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.997746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4515344-f9f9-490e-bf45-5ed823df4a39 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.039394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491fe95-ab28-4ed3-96a8-17a9f8d05504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.040549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491fe95-ab28-4ed3-96a8-17a9f8d05504 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.040982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491fe95-ab28-4ed3-96a8-17a9f8d05504 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.041270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491fe95-ab28-4ed3-96a8-17a9f8d05504 None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/e0f654bfe8364490a322b88433dd8fd2/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.057392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491fe95-ab28-4ed3-96a8-17a9f8d05504 None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=e0f654bfe8364490a322b88433dd8fd2, role_id=2c1fea0d72b84ff7b73cb582f4cf3a9e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.059120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491fe95-ab28-4ed3-96a8-17a9f8d05504 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.073379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 309/613] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:21:47 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/e0f654bfe8364490a322b88433dd8fd2/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:48.140979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703987a6-fda4-445f-ba0b-d63ed24814f0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.194420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae94f8-9ab1-47c9-bb52-669c91364df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.195029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae94f8-9ab1-47c9-bb52-669c91364df8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.195316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae94f8-9ab1-47c9-bb52-669c91364df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.195594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae94f8-9ab1-47c9-bb52-669c91364df8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.207047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae94f8-9ab1-47c9-bb52-669c91364df8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.208596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae94f8-9ab1-47c9-bb52-669c91364df8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.210894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ddae94f8-9ab1-47c9-bb52-669c91364df8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:48.222924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:48.224130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:21:48.225291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:48.230781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 305/614] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:21:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:48.235823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491fe95-ab28-4ed3-96a8-17a9f8d05504 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:48.351886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:48.355959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491fe95-ab28-4ed3-96a8-17a9f8d05504 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.402466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4bcf4-3e21-4927-a989-e263b3a53342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.403107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4bcf4-3e21-4927-a989-e263b3a53342 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.403384 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4bcf4-3e21-4927-a989-e263b3a53342 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.403658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4bcf4-3e21-4927-a989-e263b3a53342 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.404394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4bcf4-3e21-4927-a989-e263b3a53342 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:48.404697 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4bcf4-3e21-4927-a989-e263b3a53342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.406970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4bcf4-3e21-4927-a989-e263b3a53342 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.434873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 310/615] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 31 11:21:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:48.435817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae94f8-9ab1-47c9-bb52-669c91364df8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:48.594228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f56f3b-8d4a-4a52-bdd4-97d3a6e6a19a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.594934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f56f3b-8d4a-4a52-bdd4-97d3a6e6a19a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.595440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f56f3b-8d4a-4a52-bdd4-97d3a6e6a19a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.597460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 311/616] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:48.601341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae94f8-9ab1-47c9-bb52-669c91364df8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.602826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669342a-4c76-414d-a3da-a6b6c365d70e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.603319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669342a-4c76-414d-a3da-a6b6c365d70e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.603810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669342a-4c76-414d-a3da-a6b6c365d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.637507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39b191-5760-40d8-9759-0170866bef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.638201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39b191-5760-40d8-9759-0170866bef74 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.638390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39b191-5760-40d8-9759-0170866bef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.638704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39b191-5760-40d8-9759-0170866bef74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.645322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3669342a-4c76-414d-a3da-a6b6c365d70e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:48.652619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39b191-5760-40d8-9759-0170866bef74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.652619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39b191-5760-40d8-9759-0170866bef74 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.653251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3669342a-4c76-414d-a3da-a6b6c365d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8d39b191-5760-40d8-9759-0170866bef74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:48.668685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:48.669672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:48.670605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:48.670605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:48.670605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:48.670605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 306/617] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:48.675191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39b191-5760-40d8-9759-0170866bef74 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:48.765927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 312/618] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:48.814864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:48.884450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39b191-5760-40d8-9759-0170866bef74 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.923383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb3de6-26d9-46a7-b2ea-67e8eeca0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.924341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb3de6-26d9-46a7-b2ea-67e8eeca0836 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.924913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb3de6-26d9-46a7-b2ea-67e8eeca0836 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.925379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb3de6-26d9-46a7-b2ea-67e8eeca0836 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.926239 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb3de6-26d9-46a7-b2ea-67e8eeca0836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:48.926754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb3de6-26d9-46a7-b2ea-67e8eeca0836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.928306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb3de6-26d9-46a7-b2ea-67e8eeca0836 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.941898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 307/619] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:48.947219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669342a-4c76-414d-a3da-a6b6c365d70e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.033567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:49.066894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669342a-4c76-414d-a3da-a6b6c365d70e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.083106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb3de6-26d9-46a7-b2ea-67e8eeca0836 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.124857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5e098-8a41-41a3-a324-3b5ae7aa63fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.125753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5e098-8a41-41a3-a324-3b5ae7aa63fb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.126035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5e098-8a41-41a3-a324-3b5ae7aa63fb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.126309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5e098-8a41-41a3-a324-3b5ae7aa63fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.139912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5e098-8a41-41a3-a324-3b5ae7aa63fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.141943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5e098-8a41-41a3-a324-3b5ae7aa63fb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0ef5e098-8a41-41a3-a324-3b5ae7aa63fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:49.167930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:49.168900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:49.169789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:49.169789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:49.169789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:49.169789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:49.169789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:49.169789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:49.169789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:49.169789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:49.169789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 313/620] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:49.175043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5e098-8a41-41a3-a324-3b5ae7aa63fb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.254142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb3de6-26d9-46a7-b2ea-67e8eeca0836 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.266294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:49.315507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5e098-8a41-41a3-a324-3b5ae7aa63fb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.330535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd0ec6-097f-486a-83a7-951e55ffa1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.331311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd0ec6-097f-486a-83a7-951e55ffa1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.331598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd0ec6-097f-486a-83a7-951e55ffa1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.331874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd0ec6-097f-486a-83a7-951e55ffa1a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.352015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aea83d-9b8f-4d3e-be37-0d4121cb4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.352628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aea83d-9b8f-4d3e-be37-0d4121cb4d90 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.352905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aea83d-9b8f-4d3e-be37-0d4121cb4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.353175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aea83d-9b8f-4d3e-be37-0d4121cb4d90 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.353874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aea83d-9b8f-4d3e-be37-0d4121cb4d90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:49.354176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aea83d-9b8f-4d3e-be37-0d4121cb4d90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.355670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aea83d-9b8f-4d3e-be37-0d4121cb4d90 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.366711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:49.366889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd0ec6-097f-486a-83a7-951e55ffa1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-dbdd0ec6-097f-486a-83a7-951e55ffa1a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:49.371785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:49.372702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:49.373522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 308/621] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:49.379831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd0ec6-097f-486a-83a7-951e55ffa1a3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.383269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 314/622] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:49.384894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aea83d-9b8f-4d3e-be37-0d4121cb4d90 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.491634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aea83d-9b8f-4d3e-be37-0d4121cb4d90 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.526828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd0ec6-097f-486a-83a7-951e55ffa1a3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.527049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeca2d6-96bf-4732-a33a-932617712a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.527492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeca2d6-96bf-4732-a33a-932617712a43 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.527773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeca2d6-96bf-4732-a33a-932617712a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.528044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeca2d6-96bf-4732-a33a-932617712a43 None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/a1966d24e4cf4a46b71dc2ec302a8d27/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.543165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeca2d6-96bf-4732-a33a-932617712a43 None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=a1966d24e4cf4a46b71dc2ec302a8d27, role_id=2c1fea0d72b84ff7b73cb582f4cf3a9e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.544625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeca2d6-96bf-4732-a33a-932617712a43 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.567138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 315/623] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:21:49 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/a1966d24e4cf4a46b71dc2ec302a8d27/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:49.567138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e363f3-2c38-418a-a785-ef21d0be0cf0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.567138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e363f3-2c38-418a-a785-ef21d0be0cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.567138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e363f3-2c38-418a-a785-ef21d0be0cf0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.567138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 316/624] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:49.570766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164bc43-4fc5-4115-a996-0e35544c092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.571374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164bc43-4fc5-4115-a996-0e35544c092e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.571908 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164bc43-4fc5-4115-a996-0e35544c092e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.573239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8876a3-b446-41d9-b6e3-c6576143bd32 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.573521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8876a3-b446-41d9-b6e3-c6576143bd32 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.573789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8876a3-b446-41d9-b6e3-c6576143bd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.577150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164bc43-4fc5-4115-a996-0e35544c092e None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.577958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164bc43-4fc5-4115-a996-0e35544c092e None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:49.578274 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164bc43-4fc5-4115-a996-0e35544c092e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.579722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164bc43-4fc5-4115-a996-0e35544c092e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.600177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9f8876a3-b446-41d9-b6e3-c6576143bd32 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:49.600551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 309/625] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:49.601388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9f8876a3-b446-41d9-b6e3-c6576143bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:49.607759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164bc43-4fc5-4115-a996-0e35544c092e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.661961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:49.681480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 317/626] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:49.736629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:49.828185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164bc43-4fc5-4115-a996-0e35544c092e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.839588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59c9d-cfd3-423f-a2e8-6e6e53d8fc47 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.840200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59c9d-cfd3-423f-a2e8-6e6e53d8fc47 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.840683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59c9d-cfd3-423f-a2e8-6e6e53d8fc47 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.842298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 318/627] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:21:49.849067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd21ab6-1008-4d0c-85a1-fd09dc51149b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.849579 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd21ab6-1008-4d0c-85a1-fd09dc51149b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.850079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd21ab6-1008-4d0c-85a1-fd09dc51149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.868925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2ab54-f00a-4099-b0be-110163f516c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.869912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2ab54-f00a-4099-b0be-110163f516c6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.870398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2ab54-f00a-4099-b0be-110163f516c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.870904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2ab54-f00a-4099-b0be-110163f516c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.873329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bdd21ab6-1008-4d0c-85a1-fd09dc51149b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:49.876139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bdd21ab6-1008-4d0c-85a1-fd09dc51149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:49.885747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2ab54-f00a-4099-b0be-110163f516c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.887619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2ab54-f00a-4099-b0be-110163f516c6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8ad2ab54-f00a-4099-b0be-110163f516c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:49.904090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:49.905237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:49.906145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:49.906145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:49.906145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:49.908375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 310/628] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:49.915921 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2ab54-f00a-4099-b0be-110163f516c6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.991059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 319/629] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:50.024117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd21ab6-1008-4d0c-85a1-fd09dc51149b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.069510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:50.097230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2ab54-f00a-4099-b0be-110163f516c6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.147605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd21ab6-1008-4d0c-85a1-fd09dc51149b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.163006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21190a-9364-4c95-beb1-5298a1778ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.163954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21190a-9364-4c95-beb1-5298a1778ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.164432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21190a-9364-4c95-beb1-5298a1778ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.164899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21190a-9364-4c95-beb1-5298a1778ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.165732 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21190a-9364-4c95-beb1-5298a1778ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:50.166224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21190a-9364-4c95-beb1-5298a1778ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:50.167821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21190a-9364-4c95-beb1-5298a1778ed6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:50.171085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:50.194546 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 311/630] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:50.199839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21190a-9364-4c95-beb1-5298a1778ed6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.219961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcece81-bcf9-4705-9b66-a4a526acf884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.221004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcece81-bcf9-4705-9b66-a4a526acf884 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.221004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcece81-bcf9-4705-9b66-a4a526acf884 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.221271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcece81-bcf9-4705-9b66-a4a526acf884 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.238641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcece81-bcf9-4705-9b66-a4a526acf884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dfcece81-bcf9-4705-9b66-a4a526acf884 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:50.247948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:50.248937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:50.250218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 320/631] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:50.255040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcece81-bcf9-4705-9b66-a4a526acf884 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.337685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21190a-9364-4c95-beb1-5298a1778ed6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.377269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8122fed-4ef5-4e9e-9560-a4bc1bae5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.377810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8122fed-4ef5-4e9e-9560-a4bc1bae5690 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.378088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8122fed-4ef5-4e9e-9560-a4bc1bae5690 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.378355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8122fed-4ef5-4e9e-9560-a4bc1bae5690 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.385253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcece81-bcf9-4705-9b66-a4a526acf884 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.385700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8122fed-4ef5-4e9e-9560-a4bc1bae5690 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:50.387194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8122fed-4ef5-4e9e-9560-a4bc1bae5690 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-d8122fed-4ef5-4e9e-9560-a4bc1bae5690 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:50.399439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:50.400448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 11:21:50.402007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:50.405583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 312/632] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:50.406677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8122fed-4ef5-4e9e-9560-a4bc1bae5690 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.411223 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:50.431699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2e878-9d7f-493f-87fc-f0027b70bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.433149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2e878-9d7f-493f-87fc-f0027b70bf63 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.433897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2e878-9d7f-493f-87fc-f0027b70bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.434367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2e878-9d7f-493f-87fc-f0027b70bf63 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.435533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2e878-9d7f-493f-87fc-f0027b70bf63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:50.437165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2e878-9d7f-493f-87fc-f0027b70bf63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:50.439359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2e878-9d7f-493f-87fc-f0027b70bf63 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:50.451201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 321/633] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:50.452357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2e878-9d7f-493f-87fc-f0027b70bf63 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.490194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:50.525414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8122fed-4ef5-4e9e-9560-a4bc1bae5690 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.563724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361505-0a4f-4005-87fc-9cc294dbf529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.564359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361505-0a4f-4005-87fc-9cc294dbf529 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.564635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361505-0a4f-4005-87fc-9cc294dbf529 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.564909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361505-0a4f-4005-87fc-9cc294dbf529 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.575310 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1361505-0a4f-4005-87fc-9cc294dbf529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f1361505-0a4f-4005-87fc-9cc294dbf529 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:50.580476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:50.581604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:50.582601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:50.585267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2e878-9d7f-493f-87fc-f0027b70bf63 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.586236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 313/634] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:50.586995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361505-0a4f-4005-87fc-9cc294dbf529 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.623132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e26468-1df6-443f-bafb-d75d5d253e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.623783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26468-1df6-443f-bafb-d75d5d253e2d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.624277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26468-1df6-443f-bafb-d75d5d253e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.624694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26468-1df6-443f-bafb-d75d5d253e2d None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.625421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e26468-1df6-443f-bafb-d75d5d253e2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:50.625728 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e26468-1df6-443f-bafb-d75d5d253e2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:50.627187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e26468-1df6-443f-bafb-d75d5d253e2d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:50.645899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 322/635] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:50.647483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ee9cd-55c6-4310-911e-acbd146281db None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.647897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ee9cd-55c6-4310-911e-acbd146281db None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.648175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ee9cd-55c6-4310-911e-acbd146281db None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.649543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 323/636] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:50.654236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ee9cd-55c6-4310-911e-acbd146281db None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.658423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:50.702727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361505-0a4f-4005-87fc-9cc294dbf529 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.742151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e363-2ea7-4094-950c-0c50f6812d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.742796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e363-2ea7-4094-950c-0c50f6812d41 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.743073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e363-2ea7-4094-950c-0c50f6812d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.743347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e363-2ea7-4094-950c-0c50f6812d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.755122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:50.755312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4e363-2ea7-4094-950c-0c50f6812d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:50.756617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4e363-2ea7-4094-950c-0c50f6812d41 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-2ae4e363-2ea7-4094-950c-0c50f6812d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:50.771524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:50.772519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:50.773389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:50.773389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:50.773389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:50.775314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ee9cd-55c6-4310-911e-acbd146281db None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.778358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 314/637] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:50.778358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e363-2ea7-4094-950c-0c50f6812d41 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.814800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a297c1-a651-46e8-bbc3-7dc644e6c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.815410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a297c1-a651-46e8-bbc3-7dc644e6c979 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.815689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a297c1-a651-46e8-bbc3-7dc644e6c979 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.815959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a297c1-a651-46e8-bbc3-7dc644e6c979 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.816627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a297c1-a651-46e8-bbc3-7dc644e6c979 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:50.816925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a297c1-a651-46e8-bbc3-7dc644e6c979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:50.818305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a297c1-a651-46e8-bbc3-7dc644e6c979 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:50.830989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 324/638] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:50.830989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d89be-f50b-4622-a94a-e59e0a76c1e7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.830989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d89be-f50b-4622-a94a-e59e0a76c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.830989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d89be-f50b-4622-a94a-e59e0a76c1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.849092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f99d89be-f50b-4622-a94a-e59e0a76c1e7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:50.850285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f99d89be-f50b-4622-a94a-e59e0a76c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:50.891141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e363-2ea7-4094-950c-0c50f6812d41 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.909260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:50.920309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 325/639] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:50.921695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d89be-f50b-4622-a94a-e59e0a76c1e7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.941478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81aeb01-6557-432b-aa46-8d4ee81781e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.942344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81aeb01-6557-432b-aa46-8d4ee81781e7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.943304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81aeb01-6557-432b-aa46-8d4ee81781e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.943834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81aeb01-6557-432b-aa46-8d4ee81781e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.003887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.028999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81aeb01-6557-432b-aa46-8d4ee81781e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.031064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81aeb01-6557-432b-aa46-8d4ee81781e7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.031750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d89be-f50b-4622-a94a-e59e0a76c1e7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.072784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2addd-0e64-44bb-9cfa-816c6e190158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.073402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2addd-0e64-44bb-9cfa-816c6e190158 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.073711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2addd-0e64-44bb-9cfa-816c6e190158 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.073987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2addd-0e64-44bb-9cfa-816c6e190158 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.074767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2addd-0e64-44bb-9cfa-816c6e190158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:51.075069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2addd-0e64-44bb-9cfa-816c6e190158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.076514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2addd-0e64-44bb-9cfa-816c6e190158 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.089831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 326/640] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:51.090879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2addd-0e64-44bb-9cfa-816c6e190158 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.154007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 315/641] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:51.156539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81aeb01-6557-432b-aa46-8d4ee81781e7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.178714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.213791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2addd-0e64-44bb-9cfa-816c6e190158 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.252611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf81ae-7056-4317-bb91-fff0adbdbc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.253490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf81ae-7056-4317-bb91-fff0adbdbc79 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.253912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf81ae-7056-4317-bb91-fff0adbdbc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.254472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf81ae-7056-4317-bb91-fff0adbdbc79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.262744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.267852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf81ae-7056-4317-bb91-fff0adbdbc79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.269899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf81ae-7056-4317-bb91-fff0adbdbc79 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.273605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81aeb01-6557-432b-aa46-8d4ee81781e7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-83cf81ae-7056-4317-bb91-fff0adbdbc79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:51.286387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:51.287550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:51.288641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:51.288641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:51.288641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:51.290388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 327/642] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:51.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf81ae-7056-4317-bb91-fff0adbdbc79 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.315693 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe6703-47ab-4c97-a237-369a032dcfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.316745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe6703-47ab-4c97-a237-369a032dcfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.317030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe6703-47ab-4c97-a237-369a032dcfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.317302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe6703-47ab-4c97-a237-369a032dcfc6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.324478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe6703-47ab-4c97-a237-369a032dcfc6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.325911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe6703-47ab-4c97-a237-369a032dcfc6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-cbfe6703-47ab-4c97-a237-369a032dcfc6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:51.338022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:51.339293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:21:51.340468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:51.343789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 316/643] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:51.344695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe6703-47ab-4c97-a237-369a032dcfc6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.403340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf81ae-7056-4317-bb91-fff0adbdbc79 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.421771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.441914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c6fa3-b1a8-4961-a0d9-0dccc9ef1edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.442894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c6fa3-b1a8-4961-a0d9-0dccc9ef1edf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.443441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c6fa3-b1a8-4961-a0d9-0dccc9ef1edf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.443863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c6fa3-b1a8-4961-a0d9-0dccc9ef1edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.446091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe6703-47ab-4c97-a237-369a032dcfc6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.455602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c6fa3-b1a8-4961-a0d9-0dccc9ef1edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.457336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c6fa3-b1a8-4961-a0d9-0dccc9ef1edf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6c1c6fa3-b1a8-4961-a0d9-0dccc9ef1edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:51.472541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:51.473666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:51.474950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:51.474950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:51.474950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:51.481059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 328/644] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:51.482282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c6fa3-b1a8-4961-a0d9-0dccc9ef1edf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.484052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da7e4-5295-4ff6-8e05-1d37a843ccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.484670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da7e4-5295-4ff6-8e05-1d37a843ccc4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.484946 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da7e4-5295-4ff6-8e05-1d37a843ccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.485213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da7e4-5295-4ff6-8e05-1d37a843ccc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.496397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8da7e4-5295-4ff6-8e05-1d37a843ccc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7a8da7e4-5295-4ff6-8e05-1d37a843ccc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:51.502944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:51.504039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:51.507306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 317/645] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:51.508219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da7e4-5295-4ff6-8e05-1d37a843ccc4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.531855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.598117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c6fa3-b1a8-4961-a0d9-0dccc9ef1edf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.616002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da7e4-5295-4ff6-8e05-1d37a843ccc4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.634881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803ca90-7b2f-47e6-a445-e4c630dcdd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.635593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803ca90-7b2f-47e6-a445-e4c630dcdd94 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.635868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803ca90-7b2f-47e6-a445-e4c630dcdd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.636133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803ca90-7b2f-47e6-a445-e4c630dcdd94 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.636774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803ca90-7b2f-47e6-a445-e4c630dcdd94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:51.637070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803ca90-7b2f-47e6-a445-e4c630dcdd94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.638645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803ca90-7b2f-47e6-a445-e4c630dcdd94 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.649447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ff30-b9fb-43e3-8dcd-c91d0de450c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.650048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ff30-b9fb-43e3-8dcd-c91d0de450c1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.650327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ff30-b9fb-43e3-8dcd-c91d0de450c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.650599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ff30-b9fb-43e3-8dcd-c91d0de450c1 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.651360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75ff30-b9fb-43e3-8dcd-c91d0de450c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:51.651828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75ff30-b9fb-43e3-8dcd-c91d0de450c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.653281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75ff30-b9fb-43e3-8dcd-c91d0de450c1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.656811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 329/646] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:51.657245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.657830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803ca90-7b2f-47e6-a445-e4c630dcdd94 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.681400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 318/647] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:51.682290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ff30-b9fb-43e3-8dcd-c91d0de450c1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.765641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803ca90-7b2f-47e6-a445-e4c630dcdd94 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.767196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.788363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ff30-b9fb-43e3-8dcd-c91d0de450c1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.800992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bba82-c9d3-4a22-b898-d5d336dd96b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.801598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bba82-c9d3-4a22-b898-d5d336dd96b6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.801877 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bba82-c9d3-4a22-b898-d5d336dd96b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.802148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bba82-c9d3-4a22-b898-d5d336dd96b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.802817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bba82-c9d3-4a22-b898-d5d336dd96b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:51.803119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bba82-c9d3-4a22-b898-d5d336dd96b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.804490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bba82-c9d3-4a22-b898-d5d336dd96b6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.816075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 330/648] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:51.816876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bba82-c9d3-4a22-b898-d5d336dd96b6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.823356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be8fab-5ae2-4061-bce1-b5f17c5061ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.823961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8fab-5ae2-4061-bce1-b5f17c5061ad None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.824240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8fab-5ae2-4061-bce1-b5f17c5061ad None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.824513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8fab-5ae2-4061-bce1-b5f17c5061ad None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.825189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be8fab-5ae2-4061-bce1-b5f17c5061ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:51.825494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be8fab-5ae2-4061-bce1-b5f17c5061ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.826906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be8fab-5ae2-4061-bce1-b5f17c5061ad None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.834907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 319/649] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:51.835695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be8fab-5ae2-4061-bce1-b5f17c5061ad None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.890963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.914423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bba82-c9d3-4a22-b898-d5d336dd96b6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.934943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be8fab-5ae2-4061-bce1-b5f17c5061ad None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.948616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7af03-03f8-4123-91e4-bd9d44b00579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.949235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7af03-03f8-4123-91e4-bd9d44b00579 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.949508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7af03-03f8-4123-91e4-bd9d44b00579 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.949774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7af03-03f8-4123-91e4-bd9d44b00579 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.957272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7af03-03f8-4123-91e4-bd9d44b00579 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.958745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7af03-03f8-4123-91e4-bd9d44b00579 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.968039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08583f1d-91f0-48d2-a08b-74eb2113a8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.968592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583f1d-91f0-48d2-a08b-74eb2113a8ac None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.968871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583f1d-91f0-48d2-a08b-74eb2113a8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.969141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583f1d-91f0-48d2-a08b-74eb2113a8ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a8d7af03-03f8-4123-91e4-bd9d44b00579 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:51.969866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:51.970826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:51.972027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 331/650] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:51.972976 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf3b0a-4623-498d-a81e-25724ca40d84 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.973066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf3b0a-4623-498d-a81e-25724ca40d84 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.973371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf3b0a-4623-498d-a81e-25724ca40d84 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.974784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 332/651] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:51.975495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf3b0a-4623-498d-a81e-25724ca40d84 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.000054 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:52.043364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08583f1d-91f0-48d2-a08b-74eb2113a8ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.044733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08583f1d-91f0-48d2-a08b-74eb2113a8ac None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.075996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf3b0a-4623-498d-a81e-25724ca40d84 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.098885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:52.109773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1aae0d-60ce-43e3-b8ab-e5c399750cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.110393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aae0d-60ce-43e3-b8ab-e5c399750cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.110670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aae0d-60ce-43e3-b8ab-e5c399750cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.110974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aae0d-60ce-43e3-b8ab-e5c399750cb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.117581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1aae0d-60ce-43e3-b8ab-e5c399750cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.119044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1aae0d-60ce-43e3-b8ab-e5c399750cb1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6c1aae0d-60ce-43e3-b8ab-e5c399750cb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:52.130380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:52.131346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 333/652] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:52.132241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1aae0d-60ce-43e3-b8ab-e5c399750cb1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.147393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 320/653] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:52.148222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08583f1d-91f0-48d2-a08b-74eb2113a8ac None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.214602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:52.234259 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1aae0d-60ce-43e3-b8ab-e5c399750cb1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.245142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08583f1d-91f0-48d2-a08b-74eb2113a8ac None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.268392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68490f-150c-4e04-9134-b41666c1c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.269109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68490f-150c-4e04-9134-b41666c1c2de None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.269457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68490f-150c-4e04-9134-b41666c1c2de None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.269739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68490f-150c-4e04-9134-b41666c1c2de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.279688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fde2e-84df-404b-a727-a05d0458801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.280285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fde2e-84df-404b-a727-a05d0458801c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.280652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68490f-150c-4e04-9134-b41666c1c2de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.280752 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fde2e-84df-404b-a727-a05d0458801c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.280998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fde2e-84df-404b-a727-a05d0458801c None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.281727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fde2e-84df-404b-a727-a05d0458801c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:52.282030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fde2e-84df-404b-a727-a05d0458801c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.282126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68490f-150c-4e04-9134-b41666c1c2de None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.283475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fde2e-84df-404b-a727-a05d0458801c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4f68490f-150c-4e04-9134-b41666c1c2de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:52.296394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:52.297338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:52.299654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:52.299654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:52.299654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:52.299654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 334/654] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:52.299654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5da6-05d4-4192-9fd1-67c56bc5660f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.299654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5da6-05d4-4192-9fd1-67c56bc5660f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.299654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5da6-05d4-4192-9fd1-67c56bc5660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.303671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 321/655] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:52.304479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fde2e-84df-404b-a727-a05d0458801c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.318415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-330d5da6-05d4-4192-9fd1-67c56bc5660f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:52.319625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-330d5da6-05d4-4192-9fd1-67c56bc5660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:52.320878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:52.386745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 335/656] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:52.387817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d5da6-05d4-4192-9fd1-67c56bc5660f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.418020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fde2e-84df-404b-a727-a05d0458801c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.452396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:52.454827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b6f4e-52d3-4092-bb10-c73355f8e390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.455481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b6f4e-52d3-4092-bb10-c73355f8e390 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.455755 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b6f4e-52d3-4092-bb10-c73355f8e390 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.456020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b6f4e-52d3-4092-bb10-c73355f8e390 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.456703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b6f4e-52d3-4092-bb10-c73355f8e390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:52.457002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b6f4e-52d3-4092-bb10-c73355f8e390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.458417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b6f4e-52d3-4092-bb10-c73355f8e390 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.470301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 322/657] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:52.471122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b6f4e-52d3-4092-bb10-c73355f8e390 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.502363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d5da6-05d4-4192-9fd1-67c56bc5660f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.541442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2792769-bb87-4df0-a167-730728f0e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.542121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2792769-bb87-4df0-a167-730728f0e749 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.542407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2792769-bb87-4df0-a167-730728f0e749 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.542706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2792769-bb87-4df0-a167-730728f0e749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.553648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2792769-bb87-4df0-a167-730728f0e749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.555076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2792769-bb87-4df0-a167-730728f0e749 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.556763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c2792769-bb87-4df0-a167-730728f0e749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:52.575890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:52.577572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:52.578470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:52.578470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:52.578470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:52.578470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 336/658] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:52.578470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2792769-bb87-4df0-a167-730728f0e749 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.589004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b6f4e-52d3-4092-bb10-c73355f8e390 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.624975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986f73-e37a-4806-bf52-93b5b15e4a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.625678 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986f73-e37a-4806-bf52-93b5b15e4a6c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.626025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986f73-e37a-4806-bf52-93b5b15e4a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.626376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986f73-e37a-4806-bf52-93b5b15e4a6c None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.627118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0986f73-e37a-4806-bf52-93b5b15e4a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:52.627499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0986f73-e37a-4806-bf52-93b5b15e4a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.628788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0986f73-e37a-4806-bf52-93b5b15e4a6c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.645348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 323/659] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:52.645348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986f73-e37a-4806-bf52-93b5b15e4a6c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.689906 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2792769-bb87-4df0-a167-730728f0e749 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.706590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:52.724645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b17138-8893-44ab-b948-2aee38843fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.725242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b17138-8893-44ab-b948-2aee38843fcd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.725519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b17138-8893-44ab-b948-2aee38843fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.725788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b17138-8893-44ab-b948-2aee38843fcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.745049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986f73-e37a-4806-bf52-93b5b15e4a6c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.779341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d522961-d8aa-4cf4-9479-725b27168925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.780616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d522961-d8aa-4cf4-9479-725b27168925 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.780894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d522961-d8aa-4cf4-9479-725b27168925 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.781168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d522961-d8aa-4cf4-9479-725b27168925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.781894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d522961-d8aa-4cf4-9479-725b27168925 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=bb50ee2f9ccd4a258f3396074db66e74) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:52.782197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d522961-d8aa-4cf4-9479-725b27168925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.783645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d522961-d8aa-4cf4-9479-725b27168925 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.785375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:52.806802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 324/660] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/role_assignments?user.id=bb50ee2f9ccd4a258f3396074db66e74&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:52.807460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b17138-8893-44ab-b948-2aee38843fcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.807557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d522961-d8aa-4cf4-9479-725b27168925 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.807643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b17138-8893-44ab-b948-2aee38843fcd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.909458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 337/661] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:52.910466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b17138-8893-44ab-b948-2aee38843fcd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.919793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d522961-d8aa-4cf4-9479-725b27168925 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.932717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:52.959996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2e5f3-219e-4826-8329-cc1c56907d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.960601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2e5f3-219e-4826-8329-cc1c56907d19 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.960887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2e5f3-219e-4826-8329-cc1c56907d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.961246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2e5f3-219e-4826-8329-cc1c56907d19 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.961796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2e5f3-219e-4826-8329-cc1c56907d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:52.962096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2e5f3-219e-4826-8329-cc1c56907d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.963503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2e5f3-219e-4826-8329-cc1c56907d19 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.978076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 325/662] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:52.979344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2e5f3-219e-4826-8329-cc1c56907d19 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.038974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b17138-8893-44ab-b948-2aee38843fcd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.048616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:53.074167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023aa7b-5dc6-4fd3-8eca-876cc94b7698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.074887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023aa7b-5dc6-4fd3-8eca-876cc94b7698 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.075260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023aa7b-5dc6-4fd3-8eca-876cc94b7698 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.075632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023aa7b-5dc6-4fd3-8eca-876cc94b7698 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.083772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023aa7b-5dc6-4fd3-8eca-876cc94b7698 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.085302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023aa7b-5dc6-4fd3-8eca-876cc94b7698 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.095539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2e5f3-219e-4826-8329-cc1c56907d19 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f023aa7b-5dc6-4fd3-8eca-876cc94b7698 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:53.097946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:53.099073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 11:21:53.100237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:53.105325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 338/663] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:53.105325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023aa7b-5dc6-4fd3-8eca-876cc94b7698 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.144144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801bf2-19d4-489a-b738-913513645768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.144807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801bf2-19d4-489a-b738-913513645768 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.145086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801bf2-19d4-489a-b738-913513645768 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.145361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801bf2-19d4-489a-b738-913513645768 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.156077 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20801bf2-19d4-489a-b738-913513645768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-20801bf2-19d4-489a-b738-913513645768 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:53.160881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:53.161829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:53.162671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:53.166717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 326/664] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:53.167517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801bf2-19d4-489a-b738-913513645768 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.190183 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:53.214089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023aa7b-5dc6-4fd3-8eca-876cc94b7698 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.250272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122730d3-ea2a-4be0-b6df-d9aee90617c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.250942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122730d3-ea2a-4be0-b6df-d9aee90617c6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.251223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122730d3-ea2a-4be0-b6df-d9aee90617c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.251495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122730d3-ea2a-4be0-b6df-d9aee90617c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.262892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122730d3-ea2a-4be0-b6df-d9aee90617c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.264384 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122730d3-ea2a-4be0-b6df-d9aee90617c6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.278101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801bf2-19d4-489a-b738-913513645768 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-122730d3-ea2a-4be0-b6df-d9aee90617c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:53.279070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:53.280322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:53.281932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:53.281932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:53.281932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:53.281932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 339/665] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:53.281932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122730d3-ea2a-4be0-b6df-d9aee90617c6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.301432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:53.320901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a147f-5d42-43ff-86ab-46079842fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.321521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a147f-5d42-43ff-86ab-46079842fb18 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.321798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a147f-5d42-43ff-86ab-46079842fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.322066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a147f-5d42-43ff-86ab-46079842fb18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.329162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a147f-5d42-43ff-86ab-46079842fb18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.330971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a147f-5d42-43ff-86ab-46079842fb18 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-cb9a147f-5d42-43ff-86ab-46079842fb18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:53.343241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:53.344161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:53.345074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:53.345074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:53.345074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:53.345074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:53.345074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:53.345074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:53.345074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:53.345074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:53.345074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 327/666] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:53.346191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a147f-5d42-43ff-86ab-46079842fb18 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.396600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122730d3-ea2a-4be0-b6df-d9aee90617c6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.425722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:53.436087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48845a5f-5995-417f-b500-c7ff4a80d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.437220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48845a5f-5995-417f-b500-c7ff4a80d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.437777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48845a5f-5995-417f-b500-c7ff4a80d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.438047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48845a5f-5995-417f-b500-c7ff4a80d7c5 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.438815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48845a5f-5995-417f-b500-c7ff4a80d7c5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:53.439118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48845a5f-5995-417f-b500-c7ff4a80d7c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.440978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48845a5f-5995-417f-b500-c7ff4a80d7c5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.451749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a147f-5d42-43ff-86ab-46079842fb18 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.461682 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 340/667] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:53.462923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48845a5f-5995-417f-b500-c7ff4a80d7c5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.496998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53364a0-657b-43c2-8dcd-a4f212cb95af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.497600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53364a0-657b-43c2-8dcd-a4f212cb95af None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.497932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53364a0-657b-43c2-8dcd-a4f212cb95af None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.498364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53364a0-657b-43c2-8dcd-a4f212cb95af None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.500710 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53364a0-657b-43c2-8dcd-a4f212cb95af None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:53.501017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53364a0-657b-43c2-8dcd-a4f212cb95af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.502387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53364a0-657b-43c2-8dcd-a4f212cb95af None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.514836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 328/668] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:53.515674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53364a0-657b-43c2-8dcd-a4f212cb95af None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.560348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:53.575456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48845a5f-5995-417f-b500-c7ff4a80d7c5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.611694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cfb53-6e6f-400a-bd48-325c9b513ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.612223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cfb53-6e6f-400a-bd48-325c9b513ffb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.612499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cfb53-6e6f-400a-bd48-325c9b513ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.612769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cfb53-6e6f-400a-bd48-325c9b513ffb None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.613402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cfb53-6e6f-400a-bd48-325c9b513ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:53.613702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cfb53-6e6f-400a-bd48-325c9b513ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.615091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cfb53-6e6f-400a-bd48-325c9b513ffb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.622494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53364a0-657b-43c2-8dcd-a4f212cb95af None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.630776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 341/669] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:53.630776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cfb53-6e6f-400a-bd48-325c9b513ffb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.658437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542ec4-c702-4392-9c6c-987ee9f15826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.659371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542ec4-c702-4392-9c6c-987ee9f15826 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.659625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542ec4-c702-4392-9c6c-987ee9f15826 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.659896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542ec4-c702-4392-9c6c-987ee9f15826 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.660616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c542ec4-c702-4392-9c6c-987ee9f15826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:53.660917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c542ec4-c702-4392-9c6c-987ee9f15826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.662355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c542ec4-c702-4392-9c6c-987ee9f15826 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.675720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 329/670] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:53.676340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542ec4-c702-4392-9c6c-987ee9f15826 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.697974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:53.757771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cfb53-6e6f-400a-bd48-325c9b513ffb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.780046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:53.783926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542ec4-c702-4392-9c6c-987ee9f15826 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.794905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b4b28-8ed6-479e-b783-1dbc5726b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.795853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b4b28-8ed6-479e-b783-1dbc5726b905 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.795853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b4b28-8ed6-479e-b783-1dbc5726b905 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.796199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b4b28-8ed6-479e-b783-1dbc5726b905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.821177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22c4b2-d7fa-42ed-959d-f8b0d7bc1ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.821723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22c4b2-d7fa-42ed-959d-f8b0d7bc1ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.822736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22c4b2-d7fa-42ed-959d-f8b0d7bc1ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.822736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22c4b2-d7fa-42ed-959d-f8b0d7bc1ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.837101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22c4b2-d7fa-42ed-959d-f8b0d7bc1ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.839122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22c4b2-d7fa-42ed-959d-f8b0d7bc1ed2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-df22c4b2-d7fa-42ed-959d-f8b0d7bc1ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:53.855350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:53.856415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:53.857435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:53.857435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:53.857435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:53.857435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 330/671] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:53.857435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22c4b2-d7fa-42ed-959d-f8b0d7bc1ed2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.874103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b4b28-8ed6-479e-b783-1dbc5726b905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.875686 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b4b28-8ed6-479e-b783-1dbc5726b905 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.924317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:53.972744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22c4b2-d7fa-42ed-959d-f8b0d7bc1ed2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.988852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 342/672] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:53.988852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b4b28-8ed6-479e-b783-1dbc5726b905 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.013347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda49e4a-db53-4725-b388-f7a01f2434f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.014071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda49e4a-db53-4725-b388-f7a01f2434f9 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.015424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda49e4a-db53-4725-b388-f7a01f2434f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.015923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda49e4a-db53-4725-b388-f7a01f2434f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.022738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda49e4a-db53-4725-b388-f7a01f2434f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.024303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda49e4a-db53-4725-b388-f7a01f2434f9 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-dda49e4a-db53-4725-b388-f7a01f2434f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:54.035533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:54.036437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:54.037332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:54.037332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:54.037332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:54.037332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:54.037332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:54.037332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:54.037332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:54.037332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:54.037332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 331/673] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:54.037845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda49e4a-db53-4725-b388-f7a01f2434f9 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.056825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:54.099537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b4b28-8ed6-479e-b783-1dbc5726b905 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.136207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb701c7-d0ab-4635-865f-e74b3ce29623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.136740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb701c7-d0ab-4635-865f-e74b3ce29623 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.137019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb701c7-d0ab-4635-865f-e74b3ce29623 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.137291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb701c7-d0ab-4635-865f-e74b3ce29623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.138038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb701c7-d0ab-4635-865f-e74b3ce29623 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=76462c2e1ec447acbd2aba9e77ae00b1) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:54.138313 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb701c7-d0ab-4635-865f-e74b3ce29623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.140109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb701c7-d0ab-4635-865f-e74b3ce29623 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.146003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 343/674] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:53 2022] GET /identity/v3/role_assignments?user.id=76462c2e1ec447acbd2aba9e77ae00b1&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:54.146800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb701c7-d0ab-4635-865f-e74b3ce29623 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.147872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda49e4a-db53-4725-b388-f7a01f2434f9 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.169779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:54.205537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431e81-5007-4367-acc3-e41f636bc22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.206165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431e81-5007-4367-acc3-e41f636bc22b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.206447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431e81-5007-4367-acc3-e41f636bc22b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.206747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431e81-5007-4367-acc3-e41f636bc22b None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.207430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54431e81-5007-4367-acc3-e41f636bc22b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:54.208620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54431e81-5007-4367-acc3-e41f636bc22b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.210082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54431e81-5007-4367-acc3-e41f636bc22b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.230855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 332/675] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:54.232093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431e81-5007-4367-acc3-e41f636bc22b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.285103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb701c7-d0ab-4635-865f-e74b3ce29623 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.332372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690568ed-59c2-48cb-93be-86ac712dab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.333020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690568ed-59c2-48cb-93be-86ac712dab52 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.333306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690568ed-59c2-48cb-93be-86ac712dab52 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.333592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690568ed-59c2-48cb-93be-86ac712dab52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.340543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:54.347068 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690568ed-59c2-48cb-93be-86ac712dab52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.348543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690568ed-59c2-48cb-93be-86ac712dab52 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-690568ed-59c2-48cb-93be-86ac712dab52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:54.365626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:54.366619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:54.367966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:54.367966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:54.367966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:54.367966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 344/676] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:54.368802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690568ed-59c2-48cb-93be-86ac712dab52 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.396152 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431e81-5007-4367-acc3-e41f636bc22b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.446341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecec399-5087-460c-9218-137d2303bebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.447433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecec399-5087-460c-9218-137d2303bebc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.447920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecec399-5087-460c-9218-137d2303bebc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.448385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecec399-5087-460c-9218-137d2303bebc None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.449265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecec399-5087-460c-9218-137d2303bebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:54.449865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecec399-5087-460c-9218-137d2303bebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.451701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecec399-5087-460c-9218-137d2303bebc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.456627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:54.466508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 333/677] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:54.468335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecec399-5087-460c-9218-137d2303bebc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.507155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690568ed-59c2-48cb-93be-86ac712dab52 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.553877 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042f4b8-d0b3-45c2-9727-b09519218f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.554531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042f4b8-d0b3-45c2-9727-b09519218f6e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.554846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042f4b8-d0b3-45c2-9727-b09519218f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.555127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042f4b8-d0b3-45c2-9727-b09519218f6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.565951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042f4b8-d0b3-45c2-9727-b09519218f6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.567476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042f4b8-d0b3-45c2-9727-b09519218f6e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d042f4b8-d0b3-45c2-9727-b09519218f6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:54.583225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:54.584253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 345/678] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:54.585211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042f4b8-d0b3-45c2-9727-b09519218f6e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.608362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecec399-5087-460c-9218-137d2303bebc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.649261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:54.655355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb42ef-c3bf-413b-adfa-2aa5236e7d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.656193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb42ef-c3bf-413b-adfa-2aa5236e7d57 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.657168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb42ef-c3bf-413b-adfa-2aa5236e7d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.657557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb42ef-c3bf-413b-adfa-2aa5236e7d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.658456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb42ef-c3bf-413b-adfa-2aa5236e7d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:54.659019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb42ef-c3bf-413b-adfa-2aa5236e7d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.660775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb42ef-c3bf-413b-adfa-2aa5236e7d57 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.679658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 334/679] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:54.680748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb42ef-c3bf-413b-adfa-2aa5236e7d57 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.712532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042f4b8-d0b3-45c2-9727-b09519218f6e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.739051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:54.758210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00db3-efd7-43ec-aea8-286a4616a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.759010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00db3-efd7-43ec-aea8-286a4616a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.759395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00db3-efd7-43ec-aea8-286a4616a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.759774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00db3-efd7-43ec-aea8-286a4616a6b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.760612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00db3-efd7-43ec-aea8-286a4616a6b6 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=0f4db8824b7e4ae6880840e3c8680610) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:54.761046 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00db3-efd7-43ec-aea8-286a4616a6b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.762872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00db3-efd7-43ec-aea8-286a4616a6b6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.769276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 346/680] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/role_assignments?user.id=0f4db8824b7e4ae6880840e3c8680610&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:54.770342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00db3-efd7-43ec-aea8-286a4616a6b6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.820314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb42ef-c3bf-413b-adfa-2aa5236e7d57 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.861410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057636c-bde8-413b-9f31-7362ff6a0c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.862902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057636c-bde8-413b-9f31-7362ff6a0c89 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.863329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057636c-bde8-413b-9f31-7362ff6a0c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.863747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057636c-bde8-413b-9f31-7362ff6a0c89 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.864673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057636c-bde8-413b-9f31-7362ff6a0c89 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:54.865125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057636c-bde8-413b-9f31-7362ff6a0c89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.866777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057636c-bde8-413b-9f31-7362ff6a0c89 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.887219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 335/681] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:54.888766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc1ba-1c0f-4ce9-b4fe-e355425f9da6 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.889303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc1ba-1c0f-4ce9-b4fe-e355425f9da6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.889907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc1ba-1c0f-4ce9-b4fe-e355425f9da6 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.891669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 336/682] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:54.895162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc1ba-1c0f-4ce9-b4fe-e355425f9da6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.896722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00db3-efd7-43ec-aea8-286a4616a6b6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.935716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a751be2-0186-438b-bfb1-fa735e03ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.936942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a751be2-0186-438b-bfb1-fa735e03ea58 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.937233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a751be2-0186-438b-bfb1-fa735e03ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.937552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a751be2-0186-438b-bfb1-fa735e03ea58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.946344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a751be2-0186-438b-bfb1-fa735e03ea58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.947885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a751be2-0186-438b-bfb1-fa735e03ea58 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2a751be2-0186-438b-bfb1-fa735e03ea58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:54.961225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:54.962351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:54.963370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:54.963370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:54.963370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:54.963370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:54.963370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:54.963370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:54.963370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:54.963370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:54.964665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 347/683] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:54.966958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8b65-7272-44db-a787-a70b62775496 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.968299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8b65-7272-44db-a787-a70b62775496 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.968730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8b65-7272-44db-a787-a70b62775496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.971854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:54.995513 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-593a8b65-7272-44db-a787-a70b62775496 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:54.996990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-593a8b65-7272-44db-a787-a70b62775496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:55.036201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc1ba-1c0f-4ce9-b4fe-e355425f9da6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.061549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:55.073721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b4203-ee68-414e-a732-8d617293b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.074377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b4203-ee68-414e-a732-8d617293b59b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.074661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b4203-ee68-414e-a732-8d617293b59b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.074962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b4203-ee68-414e-a732-8d617293b59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.096171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 348/684] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:55.097626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8b65-7272-44db-a787-a70b62775496 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.208900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b4203-ee68-414e-a732-8d617293b59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.210275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b4203-ee68-414e-a732-8d617293b59b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.213318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8b65-7272-44db-a787-a70b62775496 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.253199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b1ee4-8bde-4f52-902b-31489dfcdc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.254177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b1ee4-8bde-4f52-902b-31489dfcdc87 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.254658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b1ee4-8bde-4f52-902b-31489dfcdc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.255166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b1ee4-8bde-4f52-902b-31489dfcdc87 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.256401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b1ee4-8bde-4f52-902b-31489dfcdc87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:55.256921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b1ee4-8bde-4f52-902b-31489dfcdc87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.259035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b1ee4-8bde-4f52-902b-31489dfcdc87 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.273674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 349/685] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:55.279035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b1ee4-8bde-4f52-902b-31489dfcdc87 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.313668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:55.320822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:55.368217 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 337/686] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:55.374756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b4203-ee68-414e-a732-8d617293b59b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.409841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b1ee4-8bde-4f52-902b-31489dfcdc87 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.469973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c9e3-d02b-4384-97a5-3cc578094276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.470510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c9e3-d02b-4384-97a5-3cc578094276 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.470822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c9e3-d02b-4384-97a5-3cc578094276 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.471098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c9e3-d02b-4384-97a5-3cc578094276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.472106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350c9e3-d02b-4384-97a5-3cc578094276 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=e0f654bfe8364490a322b88433dd8fd2) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:55.472414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350c9e3-d02b-4384-97a5-3cc578094276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.473911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350c9e3-d02b-4384-97a5-3cc578094276 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.481386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 350/687] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:55 2022] GET /identity/v3/role_assignments?user.id=e0f654bfe8364490a322b88433dd8fd2&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:55.482442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c9e3-d02b-4384-97a5-3cc578094276 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.539170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b4203-ee68-414e-a732-8d617293b59b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.613294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d47a2-2d35-4fae-8c4b-6d03ff88dddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.613939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d47a2-2d35-4fae-8c4b-6d03ff88dddf None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.614214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d47a2-2d35-4fae-8c4b-6d03ff88dddf None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.614482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d47a2-2d35-4fae-8c4b-6d03ff88dddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.633471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d47a2-2d35-4fae-8c4b-6d03ff88dddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.634985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d47a2-2d35-4fae-8c4b-6d03ff88dddf None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-267d47a2-2d35-4fae-8c4b-6d03ff88dddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:55.657968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:55.659028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:55.659938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:55.659938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:55.659938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:55.660156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:55.660619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 338/688] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:55.662533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c9e3-d02b-4384-97a5-3cc578094276 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.665705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d47a2-2d35-4fae-8c4b-6d03ff88dddf None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.669526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:55.731586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeedbd-b522-47a8-b651-6c87edfcfa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.732169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeedbd-b522-47a8-b651-6c87edfcfa6b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.732487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeedbd-b522-47a8-b651-6c87edfcfa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.733303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeedbd-b522-47a8-b651-6c87edfcfa6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.748132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeedbd-b522-47a8-b651-6c87edfcfa6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.750069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeedbd-b522-47a8-b651-6c87edfcfa6b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6adeedbd-b522-47a8-b651-6c87edfcfa6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:55.771133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:55.772115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:55.772999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:55.772999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:55.772999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:55.776426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 351/689] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:55.780601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeedbd-b522-47a8-b651-6c87edfcfa6b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.807080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d47a2-2d35-4fae-8c4b-6d03ff88dddf None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.849948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2e849-44a3-4396-ae00-22dfd5cc529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.850555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2e849-44a3-4396-ae00-22dfd5cc529a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.850873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2e849-44a3-4396-ae00-22dfd5cc529a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.851196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2e849-44a3-4396-ae00-22dfd5cc529a None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.851846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2e849-44a3-4396-ae00-22dfd5cc529a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:55.852192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2e849-44a3-4396-ae00-22dfd5cc529a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.853746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2e849-44a3-4396-ae00-22dfd5cc529a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.869326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 339/690] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:55.875604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2e849-44a3-4396-ae00-22dfd5cc529a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.913891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeedbd-b522-47a8-b651-6c87edfcfa6b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.950428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:55.960721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309026e-7dad-45c4-9886-db1a193cd19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.961341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309026e-7dad-45c4-9886-db1a193cd19e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.961621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309026e-7dad-45c4-9886-db1a193cd19e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.961895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309026e-7dad-45c4-9886-db1a193cd19e None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.962858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309026e-7dad-45c4-9886-db1a193cd19e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:55.963163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309026e-7dad-45c4-9886-db1a193cd19e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.964555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309026e-7dad-45c4-9886-db1a193cd19e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.985452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 352/691] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:55.987219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309026e-7dad-45c4-9886-db1a193cd19e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.005875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:56.052743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2e849-44a3-4396-ae00-22dfd5cc529a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.131479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b15d2-3534-46e7-822c-4f60eae0bbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.132127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b15d2-3534-46e7-822c-4f60eae0bbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.132410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b15d2-3534-46e7-822c-4f60eae0bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.132683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b15d2-3534-46e7-822c-4f60eae0bbe6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.139515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309026e-7dad-45c4-9886-db1a193cd19e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.151272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b15d2-3534-46e7-822c-4f60eae0bbe6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.152737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b15d2-3534-46e7-822c-4f60eae0bbe6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fa0b15d2-3534-46e7-822c-4f60eae0bbe6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:56.176789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:56.178970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:56.181117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:56.181117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:56.181117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:56.181117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:56.181117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:56.181117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:56.181117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:56.181117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:56.181117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 340/692] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:56.182265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7e3c7-a72c-4d73-82b3-73e0505d0a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.182265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7e3c7-a72c-4d73-82b3-73e0505d0a78 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.182265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7e3c7-a72c-4d73-82b3-73e0505d0a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.182265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7e3c7-a72c-4d73-82b3-73e0505d0a78 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.182866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7e3c7-a72c-4d73-82b3-73e0505d0a78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.182866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7e3c7-a72c-4d73-82b3-73e0505d0a78 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.187630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b15d2-3534-46e7-822c-4f60eae0bbe6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.220316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 353/693] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:21:55 2022] POST /identity/v3/users => generated 254 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:56.312672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b15d2-3534-46e7-822c-4f60eae0bbe6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.338472 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:56.351699 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6602e-f661-41a8-a79b-258c421d8100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.352316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6602e-f661-41a8-a79b-258c421d8100 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.352601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6602e-f661-41a8-a79b-258c421d8100 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.352876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6602e-f661-41a8-a79b-258c421d8100 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.353591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6602e-f661-41a8-a79b-258c421d8100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:56.353902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6602e-f661-41a8-a79b-258c421d8100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.355411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6602e-f661-41a8-a79b-258c421d8100 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.376572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 341/694] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:56.382196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7e3c7-a72c-4d73-82b3-73e0505d0a78 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.416511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0c51-7b3e-4c22-9379-fbb1626ebf7a None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.416511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0c51-7b3e-4c22-9379-fbb1626ebf7a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.416511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0c51-7b3e-4c22-9379-fbb1626ebf7a None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.416511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 342/695] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:21:56.426237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21becba3-ba25-4448-8d89-9b673666799c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.426237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21becba3-ba25-4448-8d89-9b673666799c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.426237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21becba3-ba25-4448-8d89-9b673666799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.450961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-21becba3-ba25-4448-8d89-9b673666799c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:56.454112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-21becba3-ba25-4448-8d89-9b673666799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.499327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:56.539973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 343/696] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:56.544884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7e3c7-a72c-4d73-82b3-73e0505d0a78 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.582946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff6701-5882-4311-9146-9747f159d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.583956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff6701-5882-4311-9146-9747f159d314 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.584458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff6701-5882-4311-9146-9747f159d314 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.584944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff6701-5882-4311-9146-9747f159d314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.586003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff6701-5882-4311-9146-9747f159d314 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=a1966d24e4cf4a46b71dc2ec302a8d27) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:56.586527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff6701-5882-4311-9146-9747f159d314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.588314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff6701-5882-4311-9146-9747f159d314 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.596241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 354/697] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:56 2022] GET /identity/v3/role_assignments?user.id=a1966d24e4cf4a46b71dc2ec302a8d27&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:56.829959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21becba3-ba25-4448-8d89-9b673666799c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.956056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21becba3-ba25-4448-8d89-9b673666799c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.972660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:56.996838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e900-e068-4f1a-9d4e-d01f61d7be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.997465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e900-e068-4f1a-9d4e-d01f61d7be6c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.997740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e900-e068-4f1a-9d4e-d01f61d7be6c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.998007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e900-e068-4f1a-9d4e-d01f61d7be6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.009866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12e900-e068-4f1a-9d4e-d01f61d7be6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-2c12e900-e068-4f1a-9d4e-d01f61d7be6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:57.015942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:57.016948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:57.018372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 344/698] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:57.022835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff6701-5882-4311-9146-9747f159d314 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.142603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff6701-5882-4311-9146-9747f159d314 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.175182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:57.184891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1d0f-c74d-4550-8475-693a4eb376a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:57.185505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1d0f-c74d-4550-8475-693a4eb376a0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.185780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1d0f-c74d-4550-8475-693a4eb376a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.186094 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1d0f-c74d-4550-8475-693a4eb376a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.187404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1d0f-c74d-4550-8475-693a4eb376a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:57.187712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1d0f-c74d-4550-8475-693a4eb376a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:57.189147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1d0f-c74d-4550-8475-693a4eb376a0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:57.199286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8f70d-0d14-4bb5-b49b-6e375038b2ee None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.199554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8f70d-0d14-4bb5-b49b-6e375038b2ee None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.199880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8f70d-0d14-4bb5-b49b-6e375038b2ee None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.202876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 345/699] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:57.206866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 355/700] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:57.209098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0eb62-16ec-45b6-bf2d-76aedf94319c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.209381 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0eb62-16ec-45b6-bf2d-76aedf94319c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.209652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0eb62-16ec-45b6-bf2d-76aedf94319c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.211720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1d0f-c74d-4550-8475-693a4eb376a0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.247688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-74a0eb62-16ec-45b6-bf2d-76aedf94319c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:57.249082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-74a0eb62-16ec-45b6-bf2d-76aedf94319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:57.363987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1d0f-c74d-4550-8475-693a4eb376a0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.366931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 346/701] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:57.410628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc948-ec09-424e-ac90-f23709f4d6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:57.411293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc948-ec09-424e-ac90-f23709f4d6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.411573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc948-ec09-424e-ac90-f23709f4d6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.411842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc948-ec09-424e-ac90-f23709f4d6d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.424761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc948-ec09-424e-ac90-f23709f4d6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:57.426216 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc948-ec09-424e-ac90-f23709f4d6d8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2e3cc948-ec09-424e-ac90-f23709f4d6d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:57.446779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:57.447789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:57.449918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:57.449918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:57.449918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:57.449918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 356/702] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:57.454512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0eb62-16ec-45b6-bf2d-76aedf94319c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.582437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0eb62-16ec-45b6-bf2d-76aedf94319c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.584111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:57.625471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec54c51-e5eb-489f-8593-bf7b4d1b0900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:57.626080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec54c51-e5eb-489f-8593-bf7b4d1b0900 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.626357 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec54c51-e5eb-489f-8593-bf7b4d1b0900 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.626625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec54c51-e5eb-489f-8593-bf7b4d1b0900 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.627298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec54c51-e5eb-489f-8593-bf7b4d1b0900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:57.627593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec54c51-e5eb-489f-8593-bf7b4d1b0900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:57.629000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec54c51-e5eb-489f-8593-bf7b4d1b0900 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:57.641202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 347/703] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:57.646187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc948-ec09-424e-ac90-f23709f4d6d8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.709456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:57.765771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc948-ec09-424e-ac90-f23709f4d6d8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.800645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a2578-3a3e-4f53-97cd-538767d074fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:57.801317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a2578-3a3e-4f53-97cd-538767d074fc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.801598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a2578-3a3e-4f53-97cd-538767d074fc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.801866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a2578-3a3e-4f53-97cd-538767d074fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.809535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a2578-3a3e-4f53-97cd-538767d074fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:57.811050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a2578-3a3e-4f53-97cd-538767d074fc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e77a2578-3a3e-4f53-97cd-538767d074fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:21:57.822879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:57.823832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:21:57.824858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:57.826089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 357/704] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 31 11:21:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:57.831958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec54c51-e5eb-489f-8593-bf7b4d1b0900 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.954557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec54c51-e5eb-489f-8593-bf7b4d1b0900 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.964542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a2578-3a3e-4f53-97cd-538767d074fc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.002414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e3cb8-50ed-4735-b366-4c7d44721e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.003115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e3cb8-50ed-4735-b366-4c7d44721e5c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.003436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e3cb8-50ed-4735-b366-4c7d44721e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.003758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e3cb8-50ed-4735-b366-4c7d44721e5c None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.004504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e3cb8-50ed-4735-b366-4c7d44721e5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:58.004817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e3cb8-50ed-4735-b366-4c7d44721e5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.007583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e3cb8-50ed-4735-b366-4c7d44721e5c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.039851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 348/705] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 31 11:21:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:58.040726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e3cb8-50ed-4735-b366-4c7d44721e5c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.078564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:58.150301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a2578-3a3e-4f53-97cd-538767d074fc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.167151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:58.196810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e3cb8-50ed-4735-b366-4c7d44721e5c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.218102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff7635-a511-48d9-bae2-d32b296ccf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.218895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff7635-a511-48d9-bae2-d32b296ccf90 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.219173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff7635-a511-48d9-bae2-d32b296ccf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.219442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff7635-a511-48d9-bae2-d32b296ccf90 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.220029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff7635-a511-48d9-bae2-d32b296ccf90 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.221498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff7635-a511-48d9-bae2-d32b296ccf90 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.233175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59328adf-63b4-47fc-b097-4c94680b4532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.233859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59328adf-63b4-47fc-b097-4c94680b4532 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.234137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59328adf-63b4-47fc-b097-4c94680b4532 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6cff7635-a511-48d9-bae2-d32b296ccf90 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:58.234240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:58.235251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 11:21:58.236113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:58.238203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59328adf-63b4-47fc-b097-4c94680b4532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.240169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 358/706] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 31 11:21:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:58.241446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7fb4f-d97d-4d35-8d9a-5e752e92a31b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.241725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7fb4f-d97d-4d35-8d9a-5e752e92a31b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.241999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7fb4f-d97d-4d35-8d9a-5e752e92a31b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.243523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 359/707] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:58.244237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7fb4f-d97d-4d35-8d9a-5e752e92a31b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.306435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59328adf-63b4-47fc-b097-4c94680b4532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.307940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59328adf-63b4-47fc-b097-4c94680b4532 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.330744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:58.364058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7fb4f-d97d-4d35-8d9a-5e752e92a31b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.403826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106979d3-f421-482b-8ca1-eb2f8599216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.404669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106979d3-f421-482b-8ca1-eb2f8599216f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.405714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106979d3-f421-482b-8ca1-eb2f8599216f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.406286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106979d3-f421-482b-8ca1-eb2f8599216f None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.407099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106979d3-f421-482b-8ca1-eb2f8599216f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:58.407558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106979d3-f421-482b-8ca1-eb2f8599216f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.409287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106979d3-f421-482b-8ca1-eb2f8599216f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.418490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 349/709] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:21:58.418730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 360/709] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:58.419065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52752c-c12f-4675-b81a-819ce1639741 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.419355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52752c-c12f-4675-b81a-819ce1639741 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.419633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52752c-c12f-4675-b81a-819ce1639741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.420220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106979d3-f421-482b-8ca1-eb2f8599216f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.440785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7a52752c-c12f-4675-b81a-819ce1639741 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:58.441982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7a52752c-c12f-4675-b81a-819ce1639741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:58.459144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:58.518708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 350/710] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:58.518708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52752c-c12f-4675-b81a-819ce1639741 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.551727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106979d3-f421-482b-8ca1-eb2f8599216f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.563907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:58.600843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc422-af80-4930-9abb-41c2f11f31c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.601755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc422-af80-4930-9abb-41c2f11f31c5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.602176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc422-af80-4930-9abb-41c2f11f31c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.602655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc422-af80-4930-9abb-41c2f11f31c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.614614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc422-af80-4930-9abb-41c2f11f31c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.616483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc422-af80-4930-9abb-41c2f11f31c5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.618462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52752c-c12f-4675-b81a-819ce1639741 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-66dcc422-af80-4930-9abb-41c2f11f31c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:21:58.633618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:58.634939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:21:58.636122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:21:58.636122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:21:58.636122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:58.637966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 361/711] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:58.651903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc422-af80-4930-9abb-41c2f11f31c5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.659078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9f27f-8d9e-4132-9e58-32a42b6c27bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.659690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f27f-8d9e-4132-9e58-32a42b6c27bb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.659969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f27f-8d9e-4132-9e58-32a42b6c27bb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.660243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f27f-8d9e-4132-9e58-32a42b6c27bb None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.660878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9f27f-8d9e-4132-9e58-32a42b6c27bb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:58.661178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9f27f-8d9e-4132-9e58-32a42b6c27bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.662546 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9f27f-8d9e-4132-9e58-32a42b6c27bb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.671708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 351/712] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:58.793137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:58.811270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc422-af80-4930-9abb-41c2f11f31c5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.864938 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acd735-8827-4b84-a955-86595fb903cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.865864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acd735-8827-4b84-a955-86595fb903cb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.866348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acd735-8827-4b84-a955-86595fb903cb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.866844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acd735-8827-4b84-a955-86595fb903cb None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.867678 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acd735-8827-4b84-a955-86595fb903cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:58.868191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acd735-8827-4b84-a955-86595fb903cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.869755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acd735-8827-4b84-a955-86595fb903cb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.886956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 362/713] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:58.892131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9f27f-8d9e-4132-9e58-32a42b6c27bb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.939445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e26c0b-cc7b-4ff9-87b3-958d23bfe11e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.939770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e26c0b-cc7b-4ff9-87b3-958d23bfe11e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.940003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e26c0b-cc7b-4ff9-87b3-958d23bfe11e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.942702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 363/714] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:21:58.946842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be417a6-a3fc-4550-821f-8df2e27cf593 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.947132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be417a6-a3fc-4550-821f-8df2e27cf593 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.947412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be417a6-a3fc-4550-821f-8df2e27cf593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.977154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0be417a6-a3fc-4550-821f-8df2e27cf593 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:58.978356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0be417a6-a3fc-4550-821f-8df2e27cf593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.024001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9f27f-8d9e-4132-9e58-32a42b6c27bb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.040810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:59.059705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 364/715] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 11:21:59.060894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be417a6-a3fc-4550-821f-8df2e27cf593 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.083836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012d476-0e5c-4986-9011-be3985630d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.084971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012d476-0e5c-4986-9011-be3985630d93 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.086236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012d476-0e5c-4986-9011-be3985630d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.086945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012d476-0e5c-4986-9011-be3985630d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.099889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012d476-0e5c-4986-9011-be3985630d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.101388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012d476-0e5c-4986-9011-be3985630d93 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3012d476-0e5c-4986-9011-be3985630d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:21:59.113733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:59.114668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:59.115603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:21:59.115603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:21:59.115603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:21:59.115603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:21:59.115603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:21:59.115603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:21:59.115603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:21:59.115603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:59.115603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 352/716] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:21:59.116568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac925b-771b-4ef0-ad9e-401aaed35e50 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.116666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac925b-771b-4ef0-ad9e-401aaed35e50 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.116875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac925b-771b-4ef0-ad9e-401aaed35e50 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.118662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 353/717] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:21:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:59.121273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac925b-771b-4ef0-ad9e-401aaed35e50 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.177176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:59.202489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be417a6-a3fc-4550-821f-8df2e27cf593 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.239338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2726329-dea2-4153-9a2e-0e5978a2c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.239979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2726329-dea2-4153-9a2e-0e5978a2c128 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.240259 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2726329-dea2-4153-9a2e-0e5978a2c128 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.240554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2726329-dea2-4153-9a2e-0e5978a2c128 None admin] PATH_INFO: `/v3/services/network` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.241326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2726329-dea2-4153-9a2e-0e5978a2c128 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.242798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2726329-dea2-4153-9a2e-0e5978a2c128 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b2726329-dea2-4153-9a2e-0e5978a2c128 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:59.252944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:59.253989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:59.254871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 365/718] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:59.255659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719439b0-1f99-4413-815b-c460d7750232 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.256260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719439b0-1f99-4413-815b-c460d7750232 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.256260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719439b0-1f99-4413-815b-c460d7750232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.262846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac925b-771b-4ef0-ad9e-401aaed35e50 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.275041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-719439b0-1f99-4413-815b-c460d7750232 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:59.276289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-719439b0-1f99-4413-815b-c460d7750232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.307087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d881d64-f672-4ab0-9505-81a41c56b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.308813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881d64-f672-4ab0-9505-81a41c56b44d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.309421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881d64-f672-4ab0-9505-81a41c56b44d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.309955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881d64-f672-4ab0-9505-81a41c56b44d None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.310965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881d64-f672-4ab0-9505-81a41c56b44d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:59.312079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881d64-f672-4ab0-9505-81a41c56b44d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.314887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881d64-f672-4ab0-9505-81a41c56b44d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.336370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 354/719] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:21:59.337254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d881d64-f672-4ab0-9505-81a41c56b44d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.352549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 366/720] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:21:59.353398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719439b0-1f99-4413-815b-c460d7750232 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.399035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:59.431187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:59.460972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d881d64-f672-4ab0-9505-81a41c56b44d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.469215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719439b0-1f99-4413-815b-c460d7750232 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.495471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b337e-2006-43cf-a1f1-7618977762e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.496091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b337e-2006-43cf-a1f1-7618977762e8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.496335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b337e-2006-43cf-a1f1-7618977762e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.496625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b337e-2006-43cf-a1f1-7618977762e8 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.497220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b337e-2006-43cf-a1f1-7618977762e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:59.497515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b337e-2006-43cf-a1f1-7618977762e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.499319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b337e-2006-43cf-a1f1-7618977762e8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.503692 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 355/721] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:59.504518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b337e-2006-43cf-a1f1-7618977762e8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.508050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afdd2e-d20a-471a-96eb-d39746daaa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.508946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afdd2e-d20a-471a-96eb-d39746daaa74 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.509479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afdd2e-d20a-471a-96eb-d39746daaa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.509965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afdd2e-d20a-471a-96eb-d39746daaa74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.511017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afdd2e-d20a-471a-96eb-d39746daaa74 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=76462c2e1ec447acbd2aba9e77ae00b1) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:59.511544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afdd2e-d20a-471a-96eb-d39746daaa74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.513195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afdd2e-d20a-471a-96eb-d39746daaa74 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.520343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 367/722] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/role_assignments?user.id=76462c2e1ec447acbd2aba9e77ae00b1&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=946af2ff291349299db56e09aacb6b03 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:59.521372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afdd2e-d20a-471a-96eb-d39746daaa74 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.636785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afdd2e-d20a-471a-96eb-d39746daaa74 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.665183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:59.676495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b337e-2006-43cf-a1f1-7618977762e8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.692146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efa9ab-07f0-4e59-b5b3-8345d82d7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.693051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efa9ab-07f0-4e59-b5b3-8345d82d7edd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.693459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efa9ab-07f0-4e59-b5b3-8345d82d7edd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.693857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efa9ab-07f0-4e59-b5b3-8345d82d7edd None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.694644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efa9ab-07f0-4e59-b5b3-8345d82d7edd None admin] RBAC: Adding query filter params (type=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:59.695444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efa9ab-07f0-4e59-b5b3-8345d82d7edd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.697271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efa9ab-07f0-4e59-b5b3-8345d82d7edd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.699952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:59.706979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 368/723] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:59.708766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efa9ab-07f0-4e59-b5b3-8345d82d7edd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.747926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34109e15-c1a6-433f-87dd-67b8b5c0a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.749150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34109e15-c1a6-433f-87dd-67b8b5c0a613 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.749428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34109e15-c1a6-433f-87dd-67b8b5c0a613 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.749702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34109e15-c1a6-433f-87dd-67b8b5c0a613 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.765055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34109e15-c1a6-433f-87dd-67b8b5c0a613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-34109e15-c1a6-433f-87dd-67b8b5c0a613 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:59.771972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:59.773088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:21:59.773920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:21:59.778581 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 356/724] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:59.781184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34109e15-c1a6-433f-87dd-67b8b5c0a613 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.854839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efa9ab-07f0-4e59-b5b3-8345d82d7edd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.895351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4af09c-0cd3-497d-bd03-6b02d2a2974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.895908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4af09c-0cd3-497d-bd03-6b02d2a2974c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.896234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4af09c-0cd3-497d-bd03-6b02d2a2974c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.896505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4af09c-0cd3-497d-bd03-6b02d2a2974c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.907562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4af09c-0cd3-497d-bd03-6b02d2a2974c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ca4af09c-0cd3-497d-bd03-6b02d2a2974c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:21:59.912957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:21:59.913881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:21:59.914830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 369/725] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:21:59.919857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4af09c-0cd3-497d-bd03-6b02d2a2974c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.928622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34109e15-c1a6-433f-87dd-67b8b5c0a613 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.966837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ca1a7-b4ba-4e70-8ba3-843fea3418fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.967533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ca1a7-b4ba-4e70-8ba3-843fea3418fd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.967806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ca1a7-b4ba-4e70-8ba3-843fea3418fd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.968081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ca1a7-b4ba-4e70-8ba3-843fea3418fd None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.968773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ca1a7-b4ba-4e70-8ba3-843fea3418fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:59.969196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ca1a7-b4ba-4e70-8ba3-843fea3418fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.970733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ca1a7-b4ba-4e70-8ba3-843fea3418fd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.980912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 357/726] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:59.988148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ca1a7-b4ba-4e70-8ba3-843fea3418fd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.990625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:00.019116 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:00.057827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4af09c-0cd3-497d-bd03-6b02d2a2974c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.103072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b836666-09cb-4245-9f44-dd7f3fc50dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.104565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b836666-09cb-4245-9f44-dd7f3fc50dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.105080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b836666-09cb-4245-9f44-dd7f3fc50dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.105808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b836666-09cb-4245-9f44-dd7f3fc50dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.106961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b836666-09cb-4245-9f44-dd7f3fc50dd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:00.108453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b836666-09cb-4245-9f44-dd7f3fc50dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.110600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b836666-09cb-4245-9f44-dd7f3fc50dd7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.117592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ca1a7-b4ba-4e70-8ba3-843fea3418fd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.135635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 370/727] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:00.139572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b836666-09cb-4245-9f44-dd7f3fc50dd7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.195187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74796f-b0b4-4fc0-968c-9c5d0d0216d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.195744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74796f-b0b4-4fc0-968c-9c5d0d0216d2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.196025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74796f-b0b4-4fc0-968c-9c5d0d0216d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.196301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74796f-b0b4-4fc0-968c-9c5d0d0216d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.220666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74796f-b0b4-4fc0-968c-9c5d0d0216d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.223061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74796f-b0b4-4fc0-968c-9c5d0d0216d2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4f74796f-b0b4-4fc0-968c-9c5d0d0216d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:00.245762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:00.246806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:00.247700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:00.247700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:00.247700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:00.252370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 358/728] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:00.253671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74796f-b0b4-4fc0-968c-9c5d0d0216d2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.343669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:00.367212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74796f-b0b4-4fc0-968c-9c5d0d0216d2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.398493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b836666-09cb-4245-9f44-dd7f3fc50dd7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.410194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3212606-774c-457e-8fec-29d0bf0b63d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.410918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3212606-774c-457e-8fec-29d0bf0b63d1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.411271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3212606-774c-457e-8fec-29d0bf0b63d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.411621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3212606-774c-457e-8fec-29d0bf0b63d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.412411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3212606-774c-457e-8fec-29d0bf0b63d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:00.412782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3212606-774c-457e-8fec-29d0bf0b63d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.414893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3212606-774c-457e-8fec-29d0bf0b63d1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.434835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 359/729] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:00.436226 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3212606-774c-457e-8fec-29d0bf0b63d1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.451474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:00.490041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd059bd4-2dcb-4459-be38-594f652771ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.490721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd059bd4-2dcb-4459-be38-594f652771ea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.491231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd059bd4-2dcb-4459-be38-594f652771ea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.491577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd059bd4-2dcb-4459-be38-594f652771ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.504999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd059bd4-2dcb-4459-be38-594f652771ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.506564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd059bd4-2dcb-4459-be38-594f652771ea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fd059bd4-2dcb-4459-be38-594f652771ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:00.523288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:00.524272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:00.525237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:00.525237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:00.525237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:00.530800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 371/730] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:00.534231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd059bd4-2dcb-4459-be38-594f652771ea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.651625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3212606-774c-457e-8fec-29d0bf0b63d1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.686733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:00.696982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2790fbc-1b8e-4832-b70d-c9a4cbb50e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.698816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790fbc-1b8e-4832-b70d-c9a4cbb50e0a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.700274 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790fbc-1b8e-4832-b70d-c9a4cbb50e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.700732 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790fbc-1b8e-4832-b70d-c9a4cbb50e0a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.716088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2790fbc-1b8e-4832-b70d-c9a4cbb50e0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.717618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2790fbc-1b8e-4832-b70d-c9a4cbb50e0a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.726095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd059bd4-2dcb-4459-be38-594f652771ea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c2790fbc-1b8e-4832-b70d-c9a4cbb50e0a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:00.740649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:00.741649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:00.742620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:00.749991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 360/731] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:00.754313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2790fbc-1b8e-4832-b70d-c9a4cbb50e0a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.844162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b257ba-1e2a-41b7-9299-b42e5a48f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.844735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b257ba-1e2a-41b7-9299-b42e5a48f0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.845013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b257ba-1e2a-41b7-9299-b42e5a48f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.845285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b257ba-1e2a-41b7-9299-b42e5a48f0c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.845934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b257ba-1e2a-41b7-9299-b42e5a48f0c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:00.846236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b257ba-1e2a-41b7-9299-b42e5a48f0c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.847901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b257ba-1e2a-41b7-9299-b42e5a48f0c3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.868352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2790fbc-1b8e-4832-b70d-c9a4cbb50e0a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.888762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 372/732] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:00.903920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b257ba-1e2a-41b7-9299-b42e5a48f0c3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.920819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62a980-6869-4783-a0ce-96549e421c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.922026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62a980-6869-4783-a0ce-96549e421c21 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.922800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62a980-6869-4783-a0ce-96549e421c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.923932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62a980-6869-4783-a0ce-96549e421c21 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.925456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62a980-6869-4783-a0ce-96549e421c21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:00.926233 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62a980-6869-4783-a0ce-96549e421c21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.928847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62a980-6869-4783-a0ce-96549e421c21 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.938272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:00.960218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 361/733] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:00.961823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32276bf-5776-4ddc-894a-29e404155212 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.962352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32276bf-5776-4ddc-894a-29e404155212 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.963365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32276bf-5776-4ddc-894a-29e404155212 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.969965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 362/734] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:00.970423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32276bf-5776-4ddc-894a-29e404155212 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:01.019613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b257ba-1e2a-41b7-9299-b42e5a48f0c3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:01.024424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:01.059993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4949c-b9d9-4063-80c6-939660c18c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:01.061152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4949c-b9d9-4063-80c6-939660c18c74 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.061649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4949c-b9d9-4063-80c6-939660c18c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.062175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4949c-b9d9-4063-80c6-939660c18c74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.070076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4949c-b9d9-4063-80c6-939660c18c74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:01.071933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4949c-b9d9-4063-80c6-939660c18c74 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:01.079102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32276bf-5776-4ddc-894a-29e404155212 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a7c4949c-b9d9-4063-80c6-939660c18c74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:01.085006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:01.086002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:22:01.086978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:01.089740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 373/735] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:01.091328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5c309-fcce-4aca-88ab-b797f4bf4c6d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.091824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5c309-fcce-4aca-88ab-b797f4bf4c6d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.092901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5c309-fcce-4aca-88ab-b797f4bf4c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.113989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6ff5c309-fcce-4aca-88ab-b797f4bf4c6d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:01.115673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ff5c309-fcce-4aca-88ab-b797f4bf4c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:01.122461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fdf47-f197-4b67-9d6d-464599a29667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:01.123108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fdf47-f197-4b67-9d6d-464599a29667 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.123395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fdf47-f197-4b67-9d6d-464599a29667 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.123720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fdf47-f197-4b67-9d6d-464599a29667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.198716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fdf47-f197-4b67-9d6d-464599a29667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:01.198716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fdf47-f197-4b67-9d6d-464599a29667 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:01.199307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 374/736] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:22:01.200441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5c309-fcce-4aca-88ab-b797f4bf4c6d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:01.250707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:01.268105 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:01.301533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 363/737] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:22:01.309678 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fdf47-f197-4b67-9d6d-464599a29667 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:01.428536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fdf47-f197-4b67-9d6d-464599a29667 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:01.459760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5c309-fcce-4aca-88ab-b797f4bf4c6d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:01.473183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daa774-35b4-4bf7-88a4-f5c4413c0021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:01.474644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daa774-35b4-4bf7-88a4-f5c4413c0021 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.475208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daa774-35b4-4bf7-88a4-f5c4413c0021 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.475702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daa774-35b4-4bf7-88a4-f5c4413c0021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.501517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daa774-35b4-4bf7-88a4-f5c4413c0021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:01.503687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daa774-35b4-4bf7-88a4-f5c4413c0021 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:01.527243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8b774-10e3-4c43-aba6-9763c4a8d07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:01.529070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8b774-10e3-4c43-aba6-9763c4a8d07b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.529806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8b774-10e3-4c43-aba6-9763c4a8d07b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-15daa774-35b4-4bf7-88a4-f5c4413c0021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:01.535647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:01.536571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:01.537466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:01.537466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:01.537466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:01.538401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8b774-10e3-4c43-aba6-9763c4a8d07b None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.539426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8b774-10e3-4c43-aba6-9763c4a8d07b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:01.539935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8b774-10e3-4c43-aba6-9763c4a8d07b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:01.541593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8b774-10e3-4c43-aba6-9763c4a8d07b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:01.546615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 364/738] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:01.551672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daa774-35b4-4bf7-88a4-f5c4413c0021 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:01.555543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:01.569705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 375/739] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 31 11:22:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:01.570826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8b774-10e3-4c43-aba6-9763c4a8d07b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:01.659420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:01.684376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daa774-35b4-4bf7-88a4-f5c4413c0021 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:01.685846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8b774-10e3-4c43-aba6-9763c4a8d07b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:01.722067 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5984a-98d0-4221-8220-1e7684a5a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:01.722709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5984a-98d0-4221-8220-1e7684a5a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.723149 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5984a-98d0-4221-8220-1e7684a5a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.723426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5984a-98d0-4221-8220-1e7684a5a5e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.724214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5984a-98d0-4221-8220-1e7684a5a5e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:01.724479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5984a-98d0-4221-8220-1e7684a5a5e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:01.725976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5984a-98d0-4221-8220-1e7684a5a5e2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:01.730332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77af5c5-c3b6-4a7b-9bdd-7b2871b211f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:01.731228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77af5c5-c3b6-4a7b-9bdd-7b2871b211f6 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.731707 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77af5c5-c3b6-4a7b-9bdd-7b2871b211f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.732156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77af5c5-c3b6-4a7b-9bdd-7b2871b211f6 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.733017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77af5c5-c3b6-4a7b-9bdd-7b2871b211f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:01.734588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77af5c5-c3b6-4a7b-9bdd-7b2871b211f6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:01.738969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 365/740] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:01.739956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5984a-98d0-4221-8220-1e7684a5a5e2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:01.771242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 376/741] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:22:01 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:01.772173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77af5c5-c3b6-4a7b-9bdd-7b2871b211f6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:01.808937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:01.855227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5984a-98d0-4221-8220-1e7684a5a5e2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:01.910972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259eb91-815e-47a3-a84e-f9b81b6954ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:01.911895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259eb91-815e-47a3-a84e-f9b81b6954ac None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.912331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259eb91-815e-47a3-a84e-f9b81b6954ac None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.912768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259eb91-815e-47a3-a84e-f9b81b6954ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.952514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77af5c5-c3b6-4a7b-9bdd-7b2871b211f6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:01.992941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c6030-3ca8-43c1-bae4-94252cdc948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:01.993584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c6030-3ca8-43c1-bae4-94252cdc948d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.993864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c6030-3ca8-43c1-bae4-94252cdc948d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.994137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c6030-3ca8-43c1-bae4-94252cdc948d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.994519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259eb91-815e-47a3-a84e-f9b81b6954ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:01.996369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259eb91-815e-47a3-a84e-f9b81b6954ac None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.002543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c6030-3ca8-43c1-bae4-94252cdc948d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.004218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c6030-3ca8-43c1-bae4-94252cdc948d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.006922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8a6c6030-3ca8-43c1-bae4-94252cdc948d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:02.019359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:02.020408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:02.021539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:02.021539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:02.021539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:02.021539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:02.021539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:02.021539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:02.021539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:02.021539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:02.021990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 377/742] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:02.023388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c7a2-62ed-4875-b9d6-db008f0bb700 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.023671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c7a2-62ed-4875-b9d6-db008f0bb700 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.023942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c7a2-62ed-4875-b9d6-db008f0bb700 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.026434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 378/743] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:02.027961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634446e5-d683-4332-a449-ecc3decc98f1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.028244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634446e5-d683-4332-a449-ecc3decc98f1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.028521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634446e5-d683-4332-a449-ecc3decc98f1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.030083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 379/744] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:02.030650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634446e5-d683-4332-a449-ecc3decc98f1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.072837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:02.119145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 366/745] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 11:22:02.120549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f58e-69b7-46e5-b30c-4ca1f1b57730 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.120913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f58e-69b7-46e5-b30c-4ca1f1b57730 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.121262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f58e-69b7-46e5-b30c-4ca1f1b57730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.141020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6ac5f58e-69b7-46e5-b30c-4ca1f1b57730 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:02.142222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6ac5f58e-69b7-46e5-b30c-4ca1f1b57730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:02.149476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634446e5-d683-4332-a449-ecc3decc98f1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.188929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637adcce-9dd5-4888-af6a-437fff0ba489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.189699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637adcce-9dd5-4888-af6a-437fff0ba489 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.189986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637adcce-9dd5-4888-af6a-437fff0ba489 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.190260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637adcce-9dd5-4888-af6a-437fff0ba489 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.190988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637adcce-9dd5-4888-af6a-437fff0ba489 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:02.191297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637adcce-9dd5-4888-af6a-437fff0ba489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.192778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637adcce-9dd5-4888-af6a-437fff0ba489 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.206043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 380/746] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:02.207377 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaff5c-9127-4980-92ae-cc444b6d2da3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.207669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaff5c-9127-4980-92ae-cc444b6d2da3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.207946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaff5c-9127-4980-92ae-cc444b6d2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.219003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 367/747] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:22:02.220075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5f58e-69b7-46e5-b30c-4ca1f1b57730 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.235488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bacaff5c-9127-4980-92ae-cc444b6d2da3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:02.237251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bacaff5c-9127-4980-92ae-cc444b6d2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:02.309693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:02.328534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:02.331052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 381/748] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 11:22:02.331976 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaff5c-9127-4980-92ae-cc444b6d2da3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.342784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5f58e-69b7-46e5-b30c-4ca1f1b57730 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.381027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1af70b-07b2-47f0-9b65-40a023972c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.381929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1af70b-07b2-47f0-9b65-40a023972c72 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.382358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1af70b-07b2-47f0-9b65-40a023972c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.382806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1af70b-07b2-47f0-9b65-40a023972c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.393841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1af70b-07b2-47f0-9b65-40a023972c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.395509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1af70b-07b2-47f0-9b65-40a023972c72 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.512139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaff5c-9127-4980-92ae-cc444b6d2da3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-af1af70b-07b2-47f0-9b65-40a023972c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:02.527574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:02.528758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:02.530504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:02.530504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:02.530504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:02.536343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 368/749] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:02.537342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1af70b-07b2-47f0-9b65-40a023972c72 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.550610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568686-2be1-45a2-9ab5-bae7a3115b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.551265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568686-2be1-45a2-9ab5-bae7a3115b85 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.551545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568686-2be1-45a2-9ab5-bae7a3115b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.551818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568686-2be1-45a2-9ab5-bae7a3115b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.552549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26568686-2be1-45a2-9ab5-bae7a3115b85 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=660b505867744099a74f3ade6bad2d86) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:02.552849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26568686-2be1-45a2-9ab5-bae7a3115b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.554284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26568686-2be1-45a2-9ab5-bae7a3115b85 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.560336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 382/750] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/role_assignments?user.id=660b505867744099a74f3ade6bad2d86&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:02.561619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568686-2be1-45a2-9ab5-bae7a3115b85 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.651900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1af70b-07b2-47f0-9b65-40a023972c72 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.674452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:02.690590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac570a57-eaae-4c75-abbf-3ed6ab199793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.691506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac570a57-eaae-4c75-abbf-3ed6ab199793 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.691937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac570a57-eaae-4c75-abbf-3ed6ab199793 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.692386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac570a57-eaae-4c75-abbf-3ed6ab199793 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.693214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac570a57-eaae-4c75-abbf-3ed6ab199793 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.694819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac570a57-eaae-4c75-abbf-3ed6ab199793 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.708961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:02.717466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 369/751] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:22:02 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:02.718865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac570a57-eaae-4c75-abbf-3ed6ab199793 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.758844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568686-2be1-45a2-9ab5-bae7a3115b85 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.840522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956733ff-66c0-4caf-97c7-c076e854e0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.840774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956733ff-66c0-4caf-97c7-c076e854e0ec None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.841159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956733ff-66c0-4caf-97c7-c076e854e0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.841535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956733ff-66c0-4caf-97c7-c076e854e0ec None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.842385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956733ff-66c0-4caf-97c7-c076e854e0ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:02.842909 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956733ff-66c0-4caf-97c7-c076e854e0ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.844393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956733ff-66c0-4caf-97c7-c076e854e0ec None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.859402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac570a57-eaae-4c75-abbf-3ed6ab199793 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.859996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 383/752] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:02.865689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956733ff-66c0-4caf-97c7-c076e854e0ec None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.910399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21188a33-478c-40e3-bf2c-852fe2a7d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.911310 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21188a33-478c-40e3-bf2c-852fe2a7d89d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.911738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21188a33-478c-40e3-bf2c-852fe2a7d89d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.912198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21188a33-478c-40e3-bf2c-852fe2a7d89d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.927121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21188a33-478c-40e3-bf2c-852fe2a7d89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-21188a33-478c-40e3-bf2c-852fe2a7d89d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:02.932269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:02.933215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:02.934046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:02.937223 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 370/753] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:02.947713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21188a33-478c-40e3-bf2c-852fe2a7d89d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.995676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956733ff-66c0-4caf-97c7-c076e854e0ec None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.008102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:03.022349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:03.035589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff4515-0306-48c8-a6a5-5e7aed2ac3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.036233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4515-0306-48c8-a6a5-5e7aed2ac3aa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.036511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4515-0306-48c8-a6a5-5e7aed2ac3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.036794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4515-0306-48c8-a6a5-5e7aed2ac3aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.044576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff4515-0306-48c8-a6a5-5e7aed2ac3aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.046121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff4515-0306-48c8-a6a5-5e7aed2ac3aa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ceff4515-0306-48c8-a6a5-5e7aed2ac3aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:03.057950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:03.058898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:03.059949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:03.059949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:03.059949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:03.059949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:03.059949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:03.059949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:03.059949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:03.059949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:03.059949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 384/754] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:03.066240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff4515-0306-48c8-a6a5-5e7aed2ac3aa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.083800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21188a33-478c-40e3-bf2c-852fe2a7d89d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.126943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1083a9-2526-4b79-8ba6-85c2cc6d2290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.127712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1083a9-2526-4b79-8ba6-85c2cc6d2290 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.128454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1083a9-2526-4b79-8ba6-85c2cc6d2290 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.128734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1083a9-2526-4b79-8ba6-85c2cc6d2290 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.129512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1083a9-2526-4b79-8ba6-85c2cc6d2290 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:03.129822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1083a9-2526-4b79-8ba6-85c2cc6d2290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.131229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1083a9-2526-4b79-8ba6-85c2cc6d2290 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.141903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 371/755] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:03.147919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1083a9-2526-4b79-8ba6-85c2cc6d2290 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.276747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1083a9-2526-4b79-8ba6-85c2cc6d2290 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.305609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff4515-0306-48c8-a6a5-5e7aed2ac3aa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.328901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:03.359487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51bc25-b2a1-4b9d-99ce-2f05d06adb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.360128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51bc25-b2a1-4b9d-99ce-2f05d06adb45 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.360410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51bc25-b2a1-4b9d-99ce-2f05d06adb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.360683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51bc25-b2a1-4b9d-99ce-2f05d06adb45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.361871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2f29a-c0eb-4b14-8e27-147225be8d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.362480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2f29a-c0eb-4b14-8e27-147225be8d7a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.362780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2f29a-c0eb-4b14-8e27-147225be8d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.363053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2f29a-c0eb-4b14-8e27-147225be8d7a None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.363751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2f29a-c0eb-4b14-8e27-147225be8d7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:03.364059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2f29a-c0eb-4b14-8e27-147225be8d7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.365508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2f29a-c0eb-4b14-8e27-147225be8d7a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.384220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51bc25-b2a1-4b9d-99ce-2f05d06adb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.385604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51bc25-b2a1-4b9d-99ce-2f05d06adb45 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.393014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 385/756] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:03.402561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2f29a-c0eb-4b14-8e27-147225be8d7a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fd51bc25-b2a1-4b9d-99ce-2f05d06adb45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:03.419861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:03.421707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:03.423169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:03.423169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:03.423169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:03.423169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 372/757] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:03.428262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51bc25-b2a1-4b9d-99ce-2f05d06adb45 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.461226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:03.563040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2f29a-c0eb-4b14-8e27-147225be8d7a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.574905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51bc25-b2a1-4b9d-99ce-2f05d06adb45 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.624118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd320465-8270-41aa-9359-2bb87cb43d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.624722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd320465-8270-41aa-9359-2bb87cb43d7b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.625002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd320465-8270-41aa-9359-2bb87cb43d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.625275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd320465-8270-41aa-9359-2bb87cb43d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.625997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd320465-8270-41aa-9359-2bb87cb43d7b None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=a1966d24e4cf4a46b71dc2ec302a8d27) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:03.626303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd320465-8270-41aa-9359-2bb87cb43d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.627776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd320465-8270-41aa-9359-2bb87cb43d7b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.634186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564aef-b567-4812-8df3-8d8a63f094fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.634878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564aef-b567-4812-8df3-8d8a63f094fd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.635103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564aef-b567-4812-8df3-8d8a63f094fd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.635374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564aef-b567-4812-8df3-8d8a63f094fd None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.636017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564aef-b567-4812-8df3-8d8a63f094fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:03.636317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564aef-b567-4812-8df3-8d8a63f094fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.637670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564aef-b567-4812-8df3-8d8a63f094fd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.643244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 386/758] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:03 2022] GET /identity/v3/role_assignments?user.id=a1966d24e4cf4a46b71dc2ec302a8d27&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=946af2ff291349299db56e09aacb6b03 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:03.653416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 373/759] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:03.663929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd320465-8270-41aa-9359-2bb87cb43d7b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.830485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:03.837505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd320465-8270-41aa-9359-2bb87cb43d7b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.876251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce42c18-d025-4776-afb9-b1addb899968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.876952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce42c18-d025-4776-afb9-b1addb899968 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.877243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce42c18-d025-4776-afb9-b1addb899968 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.877522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce42c18-d025-4776-afb9-b1addb899968 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.885767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce42c18-d025-4776-afb9-b1addb899968 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.887155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce42c18-d025-4776-afb9-b1addb899968 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4ce42c18-d025-4776-afb9-b1addb899968 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:03.899110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:03.900081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:03.902272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 387/760] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 31 11:22:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:03.906439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564aef-b567-4812-8df3-8d8a63f094fd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.908585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767775-b58c-4f2d-a73d-e05be5d5919d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.908729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767775-b58c-4f2d-a73d-e05be5d5919d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.908978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767775-b58c-4f2d-a73d-e05be5d5919d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.910555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 388/761] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:03.916239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc0dc8-c2a7-4a61-a04b-c5304a9d50a4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.916521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc0dc8-c2a7-4a61-a04b-c5304a9d50a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.916801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc0dc8-c2a7-4a61-a04b-c5304a9d50a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.936765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c7cc0dc8-c2a7-4a61-a04b-c5304a9d50a4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:03.938014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c7cc0dc8-c2a7-4a61-a04b-c5304a9d50a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.983095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:04.014926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 389/762] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:04.076541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564aef-b567-4812-8df3-8d8a63f094fd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.130245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939c6db-0fa0-488d-ba91-2fdc28cbf491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.130893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939c6db-0fa0-488d-ba91-2fdc28cbf491 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.131175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939c6db-0fa0-488d-ba91-2fdc28cbf491 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.131444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939c6db-0fa0-488d-ba91-2fdc28cbf491 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.132184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939c6db-0fa0-488d-ba91-2fdc28cbf491 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:04.132489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939c6db-0fa0-488d-ba91-2fdc28cbf491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.133914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939c6db-0fa0-488d-ba91-2fdc28cbf491 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.161335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 374/763] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 31 11:22:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:04.166910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc0dc8-c2a7-4a61-a04b-c5304a9d50a4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.262250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:04.282233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc0dc8-c2a7-4a61-a04b-c5304a9d50a4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.326427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5ba5c-7f36-40d0-ab30-a23cbd2e80b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.328192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5ba5c-7f36-40d0-ab30-a23cbd2e80b3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.328711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5ba5c-7f36-40d0-ab30-a23cbd2e80b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.329187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5ba5c-7f36-40d0-ab30-a23cbd2e80b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.340576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5ba5c-7f36-40d0-ab30-a23cbd2e80b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.342927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5ba5c-7f36-40d0-ab30-a23cbd2e80b3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f5f5ba5c-7f36-40d0-ab30-a23cbd2e80b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:04.366446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:04.367504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:04.368401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:04.368401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:04.368401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:04.374793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 390/764] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:04.376778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939c6db-0fa0-488d-ba91-2fdc28cbf491 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.450773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5ba5c-7f36-40d0-ab30-a23cbd2e80b3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.506178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:04.529495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939c6db-0fa0-488d-ba91-2fdc28cbf491 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.573628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5ba5c-7f36-40d0-ab30-a23cbd2e80b3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.605092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d395e5-0609-40f8-bda5-a992f0a7acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.605738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d395e5-0609-40f8-bda5-a992f0a7acb1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.606024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d395e5-0609-40f8-bda5-a992f0a7acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.606303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d395e5-0609-40f8-bda5-a992f0a7acb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.607004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d395e5-0609-40f8-bda5-a992f0a7acb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:04.607394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d395e5-0609-40f8-bda5-a992f0a7acb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.608733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d395e5-0609-40f8-bda5-a992f0a7acb1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.634361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5a41-4655-45ec-a95e-558aab5166bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.635418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5a41-4655-45ec-a95e-558aab5166bf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.635908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5a41-4655-45ec-a95e-558aab5166bf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.636386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5a41-4655-45ec-a95e-558aab5166bf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.637184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb5a41-4655-45ec-a95e-558aab5166bf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.638793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb5a41-4655-45ec-a95e-558aab5166bf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.640175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 375/765] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:04.643293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:04.645924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d395e5-0609-40f8-bda5-a992f0a7acb1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d9bb5a41-4655-45ec-a95e-558aab5166bf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:04.659250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:04.660283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 11:22:04.661117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:04.667415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 391/766] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 31 11:22:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:04.679863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5a41-4655-45ec-a95e-558aab5166bf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.855837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d395e5-0609-40f8-bda5-a992f0a7acb1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.896045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aa537-22e8-4a7a-ba58-78f00095fe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.897048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aa537-22e8-4a7a-ba58-78f00095fe90 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.897535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aa537-22e8-4a7a-ba58-78f00095fe90 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.898008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aa537-22e8-4a7a-ba58-78f00095fe90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.905873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38aa537-22e8-4a7a-ba58-78f00095fe90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.907653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38aa537-22e8-4a7a-ba58-78f00095fe90 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-a38aa537-22e8-4a7a-ba58-78f00095fe90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:04.921916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:04.922905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:04.923853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:04.923853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:04.923853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:04.923853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:04.923853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:04.923853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:04.923853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:04.923853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:04.931175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 376/767] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:04.933263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aa537-22e8-4a7a-ba58-78f00095fe90 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.950627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5a41-4655-45ec-a95e-558aab5166bf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.951457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:04.992731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777ab06-b6ec-4334-b662-ffebf3b6e83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.993427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ab06-b6ec-4334-b662-ffebf3b6e83a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.993689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ab06-b6ec-4334-b662-ffebf3b6e83a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.993964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ab06-b6ec-4334-b662-ffebf3b6e83a None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.994598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777ab06-b6ec-4334-b662-ffebf3b6e83a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:04.994923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777ab06-b6ec-4334-b662-ffebf3b6e83a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.996309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777ab06-b6ec-4334-b662-ffebf3b6e83a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.004351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 392/768] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 31 11:22:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:05.005446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60645ab-6d6e-43b1-8492-f40c9cf31e6d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.005726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60645ab-6d6e-43b1-8492-f40c9cf31e6d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.005999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60645ab-6d6e-43b1-8492-f40c9cf31e6d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.007514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 393/769] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:05.012079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60645ab-6d6e-43b1-8492-f40c9cf31e6d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.082972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aa537-22e8-4a7a-ba58-78f00095fe90 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.086314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:05.128401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc98bbd-f5a5-4583-b0a9-86696467fe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.128916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc98bbd-f5a5-4583-b0a9-86696467fe0a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.129189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc98bbd-f5a5-4583-b0a9-86696467fe0a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.129453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc98bbd-f5a5-4583-b0a9-86696467fe0a None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.130136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc98bbd-f5a5-4583-b0a9-86696467fe0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:05.130435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc98bbd-f5a5-4583-b0a9-86696467fe0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.131886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc98bbd-f5a5-4583-b0a9-86696467fe0a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.144609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60645ab-6d6e-43b1-8492-f40c9cf31e6d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.146231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 377/770] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:05.146490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929a03-da9b-448b-b3e3-c7b32655038c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.146812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929a03-da9b-448b-b3e3-c7b32655038c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.147085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929a03-da9b-448b-b3e3-c7b32655038c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.171643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-44929a03-da9b-448b-b3e3-c7b32655038c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:05.172935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-44929a03-da9b-448b-b3e3-c7b32655038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.199800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc1853-147d-4114-a10e-f4779538fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.200403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc1853-147d-4114-a10e-f4779538fc0a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.200676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc1853-147d-4114-a10e-f4779538fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.200944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc1853-147d-4114-a10e-f4779538fc0a None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.201599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc1853-147d-4114-a10e-f4779538fc0a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:05.202421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc1853-147d-4114-a10e-f4779538fc0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.204025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc1853-147d-4114-a10e-f4779538fc0a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.209400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 394/771] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 31 11:22:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:05.210049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc1853-147d-4114-a10e-f4779538fc0a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.264635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 378/772] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:05.265900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44929a03-da9b-448b-b3e3-c7b32655038c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.268567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:05.322816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc1853-147d-4114-a10e-f4779538fc0a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.351878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:05.360871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d2e6-126a-45e4-8f1e-78cd67e1b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.361514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d2e6-126a-45e4-8f1e-78cd67e1b6c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.361801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d2e6-126a-45e4-8f1e-78cd67e1b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.362076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d2e6-126a-45e4-8f1e-78cd67e1b6c5 None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/76462c2e1ec447acbd2aba9e77ae00b1/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.364429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d2e6-126a-45e4-8f1e-78cd67e1b6c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=76462c2e1ec447acbd2aba9e77ae00b1, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.365890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d2e6-126a-45e4-8f1e-78cd67e1b6c5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.382170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 395/773] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:22:05 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/76462c2e1ec447acbd2aba9e77ae00b1/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:05.382332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169da5c-899d-4844-b511-82874e2d482a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.382750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169da5c-899d-4844-b511-82874e2d482a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.383066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169da5c-899d-4844-b511-82874e2d482a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.393537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 396/774] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:05.393537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbab446-7403-4f17-bb4c-b706a6404a87 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.393537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbab446-7403-4f17-bb4c-b706a6404a87 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.393537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbab446-7403-4f17-bb4c-b706a6404a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.412989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2fbab446-7403-4f17-bb4c-b706a6404a87 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:05.414357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2fbab446-7403-4f17-bb4c-b706a6404a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.419292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44929a03-da9b-448b-b3e3-c7b32655038c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.508269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea6d12-9572-4b05-ada8-4cc5e99ae9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.508936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6d12-9572-4b05-ada8-4cc5e99ae9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.509218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6d12-9572-4b05-ada8-4cc5e99ae9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.509489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6d12-9572-4b05-ada8-4cc5e99ae9f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.510207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea6d12-9572-4b05-ada8-4cc5e99ae9f4 None admin] RBAC: Adding query filter params (interface=public, service_id=c8362b934eb84e21a7e0a616f8aed307, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:05.510515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea6d12-9572-4b05-ada8-4cc5e99ae9f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.513345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea6d12-9572-4b05-ada8-4cc5e99ae9f4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.529323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 397/775] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:05.530609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 379/776] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 31 11:22:05 2022] GET /identity/v3/endpoints?service_id=c8362b934eb84e21a7e0a616f8aed307&interface=public®ion_id=RegionOne => generated 194 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:05.537221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbab446-7403-4f17-bb4c-b706a6404a87 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.553860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea6d12-9572-4b05-ada8-4cc5e99ae9f4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.654603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:05.678705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbab446-7403-4f17-bb4c-b706a6404a87 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.694067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:05.705527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea6d12-9572-4b05-ada8-4cc5e99ae9f4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.716541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f11aa-dd6b-4c59-b82a-b2f7ed628aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.717476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f11aa-dd6b-4c59-b82a-b2f7ed628aff None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.717920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f11aa-dd6b-4c59-b82a-b2f7ed628aff None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.718281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f11aa-dd6b-4c59-b82a-b2f7ed628aff None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.719007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f11aa-dd6b-4c59-b82a-b2f7ed628aff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.720589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f11aa-dd6b-4c59-b82a-b2f7ed628aff None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.728114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 398/777] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 31 11:22:05 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:05.745360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4c90-83b5-4731-a500-f6c540696e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.746000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4c90-83b5-4731-a500-f6c540696e59 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.746275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4c90-83b5-4731-a500-f6c540696e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.746544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4c90-83b5-4731-a500-f6c540696e59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.759103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4c90-83b5-4731-a500-f6c540696e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-359b4c90-83b5-4731-a500-f6c540696e59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:05.765633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:05.766648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:05.767536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 380/778] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:22:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:05.773082 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f11aa-dd6b-4c59-b82a-b2f7ed628aff None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.859129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680694c-70be-4a23-9abd-c27079faef47 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.859442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680694c-70be-4a23-9abd-c27079faef47 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.859842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680694c-70be-4a23-9abd-c27079faef47 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.861376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 381/779] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:05.869685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fa5a5-9097-4a09-ae35-a2294eb35f31 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.870000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fa5a5-9097-4a09-ae35-a2294eb35f31 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.870408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fa5a5-9097-4a09-ae35-a2294eb35f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.893486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f11aa-dd6b-4c59-b82a-b2f7ed628aff None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.907974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-890fa5a5-9097-4a09-ae35-a2294eb35f31 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:05.909128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-890fa5a5-9097-4a09-ae35-a2294eb35f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.939983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649f55c-9656-44b0-8615-7938cead9bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.942117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649f55c-9656-44b0-8615-7938cead9bbe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.942602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649f55c-9656-44b0-8615-7938cead9bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.943965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649f55c-9656-44b0-8615-7938cead9bbe None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.944842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649f55c-9656-44b0-8615-7938cead9bbe None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:05.946923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649f55c-9656-44b0-8615-7938cead9bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.948511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649f55c-9656-44b0-8615-7938cead9bbe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.960632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 399/780] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:22:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:05.961478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649f55c-9656-44b0-8615-7938cead9bbe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.022444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 382/781] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:06.023858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fa5a5-9097-4a09-ae35-a2294eb35f31 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.033478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:06.086624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:06.136323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fa5a5-9097-4a09-ae35-a2294eb35f31 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.161035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649f55c-9656-44b0-8615-7938cead9bbe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.173081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194665e2-cb82-441a-a6d6-763e9954740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.173724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194665e2-cb82-441a-a6d6-763e9954740c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.173981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194665e2-cb82-441a-a6d6-763e9954740c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.174255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194665e2-cb82-441a-a6d6-763e9954740c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.185221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194665e2-cb82-441a-a6d6-763e9954740c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.186998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194665e2-cb82-441a-a6d6-763e9954740c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.197899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570788d-58ce-4dcc-8840-1a03232cf814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.198852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570788d-58ce-4dcc-8840-1a03232cf814 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.199314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570788d-58ce-4dcc-8840-1a03232cf814 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.199767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570788d-58ce-4dcc-8840-1a03232cf814 None admin] PATH_INFO: `/v3/services/network` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.200541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570788d-58ce-4dcc-8840-1a03232cf814 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.202951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570788d-58ce-4dcc-8840-1a03232cf814 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-194665e2-cb82-441a-a6d6-763e9954740c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:06.205319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:06.206253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:06.207393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:06.207393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:06.207393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:06.210940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 383/782] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:06.212359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194665e2-cb82-441a-a6d6-763e9954740c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1570788d-58ce-4dcc-8840-1a03232cf814 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:06.215156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:06.216324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 11:22:06.217827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:06.220126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 400/783] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:05 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:06.227691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570788d-58ce-4dcc-8840-1a03232cf814 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.333736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194665e2-cb82-441a-a6d6-763e9954740c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.344647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:06.350478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570788d-58ce-4dcc-8840-1a03232cf814 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.361070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:06.375759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94e4fa-ad88-474d-8cd8-311a43eebd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.376890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e4fa-ad88-474d-8cd8-311a43eebd51 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.377438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e4fa-ad88-474d-8cd8-311a43eebd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.377959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e4fa-ad88-474d-8cd8-311a43eebd51 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.378878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94e4fa-ad88-474d-8cd8-311a43eebd51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:06.379460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94e4fa-ad88-474d-8cd8-311a43eebd51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.381151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94e4fa-ad88-474d-8cd8-311a43eebd51 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.387990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89df6e0-0fa5-46aa-9503-bbda6d754f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.388587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89df6e0-0fa5-46aa-9503-bbda6d754f6b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.388865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89df6e0-0fa5-46aa-9503-bbda6d754f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.389211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89df6e0-0fa5-46aa-9503-bbda6d754f6b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.390389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89df6e0-0fa5-46aa-9503-bbda6d754f6b None admin] RBAC: Adding query filter params (name=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:06.390389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89df6e0-0fa5-46aa-9503-bbda6d754f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.391822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89df6e0-0fa5-46aa-9503-bbda6d754f6b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.396350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 384/784] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:06.400410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 401/785] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:06.400410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89df6e0-0fa5-46aa-9503-bbda6d754f6b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.401745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94e4fa-ad88-474d-8cd8-311a43eebd51 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.504960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89df6e0-0fa5-46aa-9503-bbda6d754f6b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.516981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94e4fa-ad88-474d-8cd8-311a43eebd51 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.541815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4a540-4eac-4b44-8535-8f5c3b40b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.542434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4a540-4eac-4b44-8535-8f5c3b40b64f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.542765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4a540-4eac-4b44-8535-8f5c3b40b64f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.543006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4a540-4eac-4b44-8535-8f5c3b40b64f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.554849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4a540-4eac-4b44-8535-8f5c3b40b64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:06.559600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169086f9-27bd-43a4-8441-5bc4fb255115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.560538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169086f9-27bd-43a4-8441-5bc4fb255115 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-55b4a540-4eac-4b44-8535-8f5c3b40b64f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:06.561159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:06.562151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:06.563050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:06.564391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169086f9-27bd-43a4-8441-5bc4fb255115 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.564877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169086f9-27bd-43a4-8441-5bc4fb255115 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.566766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 402/786] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:06.568287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4a540-4eac-4b44-8535-8f5c3b40b64f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.576713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169086f9-27bd-43a4-8441-5bc4fb255115 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.578396 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169086f9-27bd-43a4-8441-5bc4fb255115 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-169086f9-27bd-43a4-8441-5bc4fb255115 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:06.591460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:06.593203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:06.594316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:06.596214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 385/787] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:06.597590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169086f9-27bd-43a4-8441-5bc4fb255115 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.609742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:06.631492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:06.697454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4a540-4eac-4b44-8535-8f5c3b40b64f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.711078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169086f9-27bd-43a4-8441-5bc4fb255115 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.737542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498f40f-9ebc-4265-b9e6-b124d7270cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.738634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498f40f-9ebc-4265-b9e6-b124d7270cbb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.739379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498f40f-9ebc-4265-b9e6-b124d7270cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.739809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498f40f-9ebc-4265-b9e6-b124d7270cbb None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.741026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498f40f-9ebc-4265-b9e6-b124d7270cbb None admin] RBAC: Adding query filter params (type=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:06.741739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498f40f-9ebc-4265-b9e6-b124d7270cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.743931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498f40f-9ebc-4265-b9e6-b124d7270cbb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.748798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3ba8f-b2ab-40ce-a2d6-51344c99657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.749794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3ba8f-b2ab-40ce-a2d6-51344c99657d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.750172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3ba8f-b2ab-40ce-a2d6-51344c99657d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.750490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 403/788] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:06.750619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3ba8f-b2ab-40ce-a2d6-51344c99657d None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.751468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3ba8f-b2ab-40ce-a2d6-51344c99657d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:06.751741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498f40f-9ebc-4265-b9e6-b124d7270cbb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.756625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3ba8f-b2ab-40ce-a2d6-51344c99657d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.758151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3ba8f-b2ab-40ce-a2d6-51344c99657d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.774702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 386/789] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:06.774702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3ba8f-b2ab-40ce-a2d6-51344c99657d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.878461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:06.882884 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:06.884679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498f40f-9ebc-4265-b9e6-b124d7270cbb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.895993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3ba8f-b2ab-40ce-a2d6-51344c99657d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.922102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc15ab-336d-47b2-98aa-8e1e2f18f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.922735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc15ab-336d-47b2-98aa-8e1e2f18f986 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.923224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc15ab-336d-47b2-98aa-8e1e2f18f986 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.923503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc15ab-336d-47b2-98aa-8e1e2f18f986 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.924244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc15ab-336d-47b2-98aa-8e1e2f18f986 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:06.924545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc15ab-336d-47b2-98aa-8e1e2f18f986 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.925978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc15ab-336d-47b2-98aa-8e1e2f18f986 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.935929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b60c1-c45f-41c5-b1eb-8055f6a6dbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.937489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b60c1-c45f-41c5-b1eb-8055f6a6dbee None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.937976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b60c1-c45f-41c5-b1eb-8055f6a6dbee None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.938465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b60c1-c45f-41c5-b1eb-8055f6a6dbee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.939421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b60c1-c45f-41c5-b1eb-8055f6a6dbee None admin] RBAC: Adding query filter params (interface=public, service_id=4e48f628d9e54925943b3fe1a81928db, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:06.939948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b60c1-c45f-41c5-b1eb-8055f6a6dbee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.941670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b60c1-c45f-41c5-b1eb-8055f6a6dbee None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.944869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 404/790] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:06.945814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc15ab-336d-47b2-98aa-8e1e2f18f986 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.948266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 387/791] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/endpoints?service_id=4e48f628d9e54925943b3fe1a81928db&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:06.949767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b60c1-c45f-41c5-b1eb-8055f6a6dbee None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.057028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc15ab-336d-47b2-98aa-8e1e2f18f986 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.062246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b60c1-c45f-41c5-b1eb-8055f6a6dbee None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.091855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823e974-700f-4b91-a7cb-0567831b03d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.093173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e974-700f-4b91-a7cb-0567831b03d9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.093662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e974-700f-4b91-a7cb-0567831b03d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.093955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e974-700f-4b91-a7cb-0567831b03d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.101645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040faba0-0ded-45e9-b97f-b14ffb410610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.102639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040faba0-0ded-45e9-b97f-b14ffb410610 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.103149 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040faba0-0ded-45e9-b97f-b14ffb410610 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.103823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040faba0-0ded-45e9-b97f-b14ffb410610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.104526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823e974-700f-4b91-a7cb-0567831b03d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.105983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823e974-700f-4b91-a7cb-0567831b03d9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.116137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040faba0-0ded-45e9-b97f-b14ffb410610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.117846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040faba0-0ded-45e9-b97f-b14ffb410610 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6823e974-700f-4b91-a7cb-0567831b03d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:07.121844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:07.122803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:07.123744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:07.123744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:07.123744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:07.128257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 405/792] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:07.129115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823e974-700f-4b91-a7cb-0567831b03d9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-040faba0-0ded-45e9-b97f-b14ffb410610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:07.136743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:07.137731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:07.138617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:07.138617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:07.138617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:07.140924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:07.141566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 388/793] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:07.142935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040faba0-0ded-45e9-b97f-b14ffb410610 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.153430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:07.241348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823e974-700f-4b91-a7cb-0567831b03d9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.255427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040faba0-0ded-45e9-b97f-b14ffb410610 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.278870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef451-4ad9-4571-ac9c-a0dad91c73db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.279478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef451-4ad9-4571-ac9c-a0dad91c73db None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.280365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef451-4ad9-4571-ac9c-a0dad91c73db None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.280840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef451-4ad9-4571-ac9c-a0dad91c73db None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.281660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ef451-4ad9-4571-ac9c-a0dad91c73db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.283177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ef451-4ad9-4571-ac9c-a0dad91c73db None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.294862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 406/794] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 31 11:22:07 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:07.295322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5b7e4-01f5-47ad-bc76-948a498bd443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.296738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5b7e4-01f5-47ad-bc76-948a498bd443 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.296942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef451-4ad9-4571-ac9c-a0dad91c73db None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.297526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5b7e4-01f5-47ad-bc76-948a498bd443 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.298010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5b7e4-01f5-47ad-bc76-948a498bd443 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.298957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5b7e4-01f5-47ad-bc76-948a498bd443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:07.299493 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5b7e4-01f5-47ad-bc76-948a498bd443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.301216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5b7e4-01f5-47ad-bc76-948a498bd443 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.316689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 389/795] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:07.334904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5b7e4-01f5-47ad-bc76-948a498bd443 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.395097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:07.432303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef451-4ad9-4571-ac9c-a0dad91c73db None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.457117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:07.478009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c64b6-5564-4c14-b09d-c3c8eb301092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.478616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c64b6-5564-4c14-b09d-c3c8eb301092 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.478923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c64b6-5564-4c14-b09d-c3c8eb301092 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.479192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c64b6-5564-4c14-b09d-c3c8eb301092 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.479937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c64b6-5564-4c14-b09d-c3c8eb301092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:07.480241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c64b6-5564-4c14-b09d-c3c8eb301092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.481804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c64b6-5564-4c14-b09d-c3c8eb301092 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.497675 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5b7e4-01f5-47ad-bc76-948a498bd443 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.539289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93a679-b68e-4e88-baf1-0e911913abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.540433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93a679-b68e-4e88-baf1-0e911913abd7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.540951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93a679-b68e-4e88-baf1-0e911913abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.541457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93a679-b68e-4e88-baf1-0e911913abd7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.551965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93a679-b68e-4e88-baf1-0e911913abd7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.553824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93a679-b68e-4e88-baf1-0e911913abd7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4a93a679-b68e-4e88-baf1-0e911913abd7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:07.568288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:07.569294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:22:07.570244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:07.574098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 390/796] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:07.580698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93a679-b68e-4e88-baf1-0e911913abd7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.633691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 407/797] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:07.640665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c64b6-5564-4c14-b09d-c3c8eb301092 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.721683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93a679-b68e-4e88-baf1-0e911913abd7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.763161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c64b6-5564-4c14-b09d-c3c8eb301092 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.772034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:07.786653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651aa926-aba1-4f16-b033-4cb99357aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.787488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651aa926-aba1-4f16-b033-4cb99357aeea None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.787765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651aa926-aba1-4f16-b033-4cb99357aeea None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.788369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651aa926-aba1-4f16-b033-4cb99357aeea None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.789378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651aa926-aba1-4f16-b033-4cb99357aeea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:07.789687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651aa926-aba1-4f16-b033-4cb99357aeea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.791657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651aa926-aba1-4f16-b033-4cb99357aeea None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.793339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:07.801296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4e6df-e2e1-424b-9aad-e1cbfb75ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.801926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4e6df-e2e1-424b-9aad-e1cbfb75ddfb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.802201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4e6df-e2e1-424b-9aad-e1cbfb75ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.802471 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4e6df-e2e1-424b-9aad-e1cbfb75ddfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.809718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4e6df-e2e1-424b-9aad-e1cbfb75ddfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.811786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4e6df-e2e1-424b-9aad-e1cbfb75ddfb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.814768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 391/798] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 31 11:22:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:07.816073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c646d-0dd1-44c3-a840-04047ea770e7 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.816353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c646d-0dd1-44c3-a840-04047ea770e7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.816623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c646d-0dd1-44c3-a840-04047ea770e7 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.822887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 392/799] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:07.823894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c646d-0dd1-44c3-a840-04047ea770e7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b6c4e6df-e2e1-424b-9aad-e1cbfb75ddfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:07.832564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:07.833460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:07.834353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:07.834353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:07.834353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:07.834353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:07.834353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:07.834353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:07.834353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:07.834353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:07.834353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 408/800] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:07.835577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc1724-f6b4-4b65-b9da-2bdb63274a5d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.835577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc1724-f6b4-4b65-b9da-2bdb63274a5d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.835863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc1724-f6b4-4b65-b9da-2bdb63274a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.854951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7afc1724-f6b4-4b65-b9da-2bdb63274a5d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:07.856173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7afc1724-f6b4-4b65-b9da-2bdb63274a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:07.929489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 409/801] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:07.930338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc1724-f6b4-4b65-b9da-2bdb63274a5d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.960459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c646d-0dd1-44c3-a840-04047ea770e7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.000209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ce4d-5505-40be-8863-c0dc9d83e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.001015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ce4d-5505-40be-8863-c0dc9d83e007 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.001322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ce4d-5505-40be-8863-c0dc9d83e007 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.001599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ce4d-5505-40be-8863-c0dc9d83e007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.012877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5ce4d-5505-40be-8863-c0dc9d83e007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.015400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5ce4d-5505-40be-8863-c0dc9d83e007 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-12f5ce4d-5505-40be-8863-c0dc9d83e007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:08.031359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:08.032355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:08.033259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:08.033259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:08.033259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:08.036305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 393/802] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:08.037782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da142243-f1ef-4c70-97d2-dd1324d1bd15 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.038070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da142243-f1ef-4c70-97d2-dd1324d1bd15 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.038345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da142243-f1ef-4c70-97d2-dd1324d1bd15 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.039652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 394/803] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:08.044255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da142243-f1ef-4c70-97d2-dd1324d1bd15 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.070245 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc1724-f6b4-4b65-b9da-2bdb63274a5d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.088814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:08.097894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:08.120851 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d6f13-8d4e-4dcc-9390-45d98cf281fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.122052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d6f13-8d4e-4dcc-9390-45d98cf281fd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.122583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d6f13-8d4e-4dcc-9390-45d98cf281fd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.123808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d6f13-8d4e-4dcc-9390-45d98cf281fd None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.125125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d6f13-8d4e-4dcc-9390-45d98cf281fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:08.125599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d6f13-8d4e-4dcc-9390-45d98cf281fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.127269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d6f13-8d4e-4dcc-9390-45d98cf281fd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.141659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 410/804] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:08.143321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746162f-d2ab-4438-b72a-1ad2c29039bf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.143789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746162f-d2ab-4438-b72a-1ad2c29039bf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.144266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746162f-d2ab-4438-b72a-1ad2c29039bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.163943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7746162f-d2ab-4438-b72a-1ad2c29039bf None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:08.165384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da142243-f1ef-4c70-97d2-dd1324d1bd15 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.165722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7746162f-d2ab-4438-b72a-1ad2c29039bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:08.200717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce076ea3-05f9-4142-8f9f-ee3fe492fd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.201480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce076ea3-05f9-4142-8f9f-ee3fe492fd78 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.201831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce076ea3-05f9-4142-8f9f-ee3fe492fd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.202172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce076ea3-05f9-4142-8f9f-ee3fe492fd78 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.202917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce076ea3-05f9-4142-8f9f-ee3fe492fd78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:08.203289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce076ea3-05f9-4142-8f9f-ee3fe492fd78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.204804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce076ea3-05f9-4142-8f9f-ee3fe492fd78 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.218774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 395/805] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:08.219653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce076ea3-05f9-4142-8f9f-ee3fe492fd78 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.242661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 411/806] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:08.243773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746162f-d2ab-4438-b72a-1ad2c29039bf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.331928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:08.338374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce076ea3-05f9-4142-8f9f-ee3fe492fd78 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.351273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746162f-d2ab-4438-b72a-1ad2c29039bf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.364357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:08.380329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5b27-878c-42c4-8815-3cd9f4d51bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.381462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5b27-878c-42c4-8815-3cd9f4d51bfd None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.381969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5b27-878c-42c4-8815-3cd9f4d51bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.382431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5b27-878c-42c4-8815-3cd9f4d51bfd None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/660b505867744099a74f3ade6bad2d86/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.389718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037b30f-9973-459a-8394-692585cd6197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.390342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037b30f-9973-459a-8394-692585cd6197 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.390614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037b30f-9973-459a-8394-692585cd6197 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.390928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037b30f-9973-459a-8394-692585cd6197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.399858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb5b27-878c-42c4-8815-3cd9f4d51bfd None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=660b505867744099a74f3ade6bad2d86, role_id=2c1fea0d72b84ff7b73cb582f4cf3a9e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.401537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb5b27-878c-42c4-8815-3cd9f4d51bfd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.401648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037b30f-9973-459a-8394-692585cd6197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5037b30f-9973-459a-8394-692585cd6197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:08.406564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:08.407756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:08.408660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:08.412764 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 412/807] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:08.413595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037b30f-9973-459a-8394-692585cd6197 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.423728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 396/808] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:22:08 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/660b505867744099a74f3ade6bad2d86/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:08.425291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5b27-878c-42c4-8815-3cd9f4d51bfd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.526325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037b30f-9973-459a-8394-692585cd6197 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.564569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5b27-878c-42c4-8815-3cd9f4d51bfd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.576087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfb153-c2e8-4916-baf9-5e7e19901df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.578272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfb153-c2e8-4916-baf9-5e7e19901df1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.578877 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfb153-c2e8-4916-baf9-5e7e19901df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.579636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfb153-c2e8-4916-baf9-5e7e19901df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.589913 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfb153-c2e8-4916-baf9-5e7e19901df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.592670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfb153-c2e8-4916-baf9-5e7e19901df1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.609444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9151c-f337-42c3-b8ef-763ef4438e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.610072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9151c-f337-42c3-b8ef-763ef4438e44 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.610422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9151c-f337-42c3-b8ef-763ef4438e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.610792 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9151c-f337-42c3-b8ef-763ef4438e44 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.611545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9151c-f337-42c3-b8ef-763ef4438e44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:08.612023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9151c-f337-42c3-b8ef-763ef4438e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7fbfb153-c2e8-4916-baf9-5e7e19901df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:08.612932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:08.614017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:08.615423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:08.615423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:08.615423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:08.615423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:08.615423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:08.615423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:08.615423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:08.615423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:08.616290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9151c-f337-42c3-b8ef-763ef4438e44 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.621960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 413/809] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:08.624403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfb153-c2e8-4916-baf9-5e7e19901df1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.634933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 397/810] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:08.635592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9151c-f337-42c3-b8ef-763ef4438e44 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.656852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:08.664072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:08.744178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfb153-c2e8-4916-baf9-5e7e19901df1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.766072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9151c-f337-42c3-b8ef-763ef4438e44 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.778818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a8804-eece-40ff-8d3b-6b5081d38944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.779465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a8804-eece-40ff-8d3b-6b5081d38944 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.780252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a8804-eece-40ff-8d3b-6b5081d38944 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.780532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a8804-eece-40ff-8d3b-6b5081d38944 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.781119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a8804-eece-40ff-8d3b-6b5081d38944 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.782505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a8804-eece-40ff-8d3b-6b5081d38944 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-170a8804-eece-40ff-8d3b-6b5081d38944 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:08.791980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:08.792987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:08.793838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 414/811] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:08.794635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a8804-eece-40ff-8d3b-6b5081d38944 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.815467 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690c237-ecc3-4dd7-a11c-e5e9edac1196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.816469 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690c237-ecc3-4dd7-a11c-e5e9edac1196 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.816975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690c237-ecc3-4dd7-a11c-e5e9edac1196 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.817449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690c237-ecc3-4dd7-a11c-e5e9edac1196 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.818394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690c237-ecc3-4dd7-a11c-e5e9edac1196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:08.818927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690c237-ecc3-4dd7-a11c-e5e9edac1196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.820647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690c237-ecc3-4dd7-a11c-e5e9edac1196 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.835225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 398/812] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:08.836489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690c237-ecc3-4dd7-a11c-e5e9edac1196 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.899600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:08.906830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a8804-eece-40ff-8d3b-6b5081d38944 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.911748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:08.945919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdef669-9a56-476f-a4d8-925a61ef688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.946863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdef669-9a56-476f-a4d8-925a61ef688e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.947288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdef669-9a56-476f-a4d8-925a61ef688e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.947705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdef669-9a56-476f-a4d8-925a61ef688e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.949877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690c237-ecc3-4dd7-a11c-e5e9edac1196 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.958915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdef669-9a56-476f-a4d8-925a61ef688e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.960597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdef669-9a56-476f-a4d8-925a61ef688e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ecdef669-9a56-476f-a4d8-925a61ef688e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:08.975784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:08.976744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:08.977630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:08.977630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:08.977630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:08.979717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 415/813] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:08.980646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdef669-9a56-476f-a4d8-925a61ef688e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.989718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7e59-046a-4b97-a339-494901e8b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.990442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7e59-046a-4b97-a339-494901e8b32b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.990836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7e59-046a-4b97-a339-494901e8b32b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.991176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7e59-046a-4b97-a339-494901e8b32b None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.992451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7e59-046a-4b97-a339-494901e8b32b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:08.992828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7e59-046a-4b97-a339-494901e8b32b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.994766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7e59-046a-4b97-a339-494901e8b32b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:09.006330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 399/814] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:09.007484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7e59-046a-4b97-a339-494901e8b32b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:09.104755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdef669-9a56-476f-a4d8-925a61ef688e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:09.144028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b94cc-114b-4362-aa79-d7a0c220b970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:09.144733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b94cc-114b-4362-aa79-d7a0c220b970 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.145016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b94cc-114b-4362-aa79-d7a0c220b970 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.145269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7e59-046a-4b97-a339-494901e8b32b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:09.145393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b94cc-114b-4362-aa79-d7a0c220b970 None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/a1966d24e4cf4a46b71dc2ec302a8d27/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.147344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b94cc-114b-4362-aa79-d7a0c220b970 None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=a1966d24e4cf4a46b71dc2ec302a8d27, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:09.149194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b94cc-114b-4362-aa79-d7a0c220b970 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:09.165212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 416/815] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:22:08 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/a1966d24e4cf4a46b71dc2ec302a8d27/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:09.166157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b94cc-114b-4362-aa79-d7a0c220b970 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:09.177942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:09.181768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:09.191313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5c69-f2f5-43ae-bd61-f5e58927a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:09.192366 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5c69-f2f5-43ae-bd61-f5e58927a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.192853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5c69-f2f5-43ae-bd61-f5e58927a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.193329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5c69-f2f5-43ae-bd61-f5e58927a9c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.194261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5c69-f2f5-43ae-bd61-f5e58927a9c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:09.194958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5c69-f2f5-43ae-bd61-f5e58927a9c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:09.196787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5c69-f2f5-43ae-bd61-f5e58927a9c8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:09.210668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 400/816] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:09.215950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5c69-f2f5-43ae-bd61-f5e58927a9c8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:09.291311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b94cc-114b-4362-aa79-d7a0c220b970 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:09.332632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5c69-f2f5-43ae-bd61-f5e58927a9c8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:09.344719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d55ed-f515-44a8-ba92-ea9d315b081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:09.345558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d55ed-f515-44a8-ba92-ea9d315b081a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.345672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d55ed-f515-44a8-ba92-ea9d315b081a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.345867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d55ed-f515-44a8-ba92-ea9d315b081a None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.346490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d55ed-f515-44a8-ba92-ea9d315b081a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:09.346813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d55ed-f515-44a8-ba92-ea9d315b081a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:09.348454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d55ed-f515-44a8-ba92-ea9d315b081a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:09.362250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 417/817] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 31 11:22:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:09.375996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d55ed-f515-44a8-ba92-ea9d315b081a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:09.379235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7fc9a-76fd-43a2-8340-1b53fd25c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:09.380235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7fc9a-76fd-43a2-8340-1b53fd25c0fa None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.380729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7fc9a-76fd-43a2-8340-1b53fd25c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.381206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7fc9a-76fd-43a2-8340-1b53fd25c0fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.390530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7fc9a-76fd-43a2-8340-1b53fd25c0fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:09.392352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7fc9a-76fd-43a2-8340-1b53fd25c0fa None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-feb7fc9a-76fd-43a2-8340-1b53fd25c0fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:09.405788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:09.406841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:09.407780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:09.410398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 401/818] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 31 11:22:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:09.417051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7fc9a-76fd-43a2-8340-1b53fd25c0fa None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:09.484809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:09.491598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:09.535925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d55ed-f515-44a8-ba92-ea9d315b081a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:09.559824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7fc9a-76fd-43a2-8340-1b53fd25c0fa None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:09.594808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da23275-6cff-4d51-aca7-69e4ee8dc944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:09.595878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da23275-6cff-4d51-aca7-69e4ee8dc944 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.596164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da23275-6cff-4d51-aca7-69e4ee8dc944 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.596716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da23275-6cff-4d51-aca7-69e4ee8dc944 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.597648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da23275-6cff-4d51-aca7-69e4ee8dc944 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:09.599991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da23275-6cff-4d51-aca7-69e4ee8dc944 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:09.606602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b241e-8e61-4d03-b864-23c338fbb690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:09.607553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b241e-8e61-4d03-b864-23c338fbb690 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.608402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b241e-8e61-4d03-b864-23c338fbb690 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.609083 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b241e-8e61-4d03-b864-23c338fbb690 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.609823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b241e-8e61-4d03-b864-23c338fbb690 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:09.610125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b241e-8e61-4d03-b864-23c338fbb690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:09.611726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b241e-8e61-4d03-b864-23c338fbb690 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:09.627630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 418/819] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:09.629089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8d66c-ede5-4a77-80f9-06251e58e8b5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.630011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8d66c-ede5-4a77-80f9-06251e58e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.630346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8d66c-ede5-4a77-80f9-06251e58e8b5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.632253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 419/820] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:09.633216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 402/821] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 31 11:22:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:09.639449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08bfd3-efcd-490c-b186-8053c181f768 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.641662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08bfd3-efcd-490c-b186-8053c181f768 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.641662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08bfd3-efcd-490c-b186-8053c181f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.641890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b241e-8e61-4d03-b864-23c338fbb690 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:09.659560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5a08bfd3-efcd-490c-b186-8053c181f768 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:09.660771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a08bfd3-efcd-490c-b186-8053c181f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:09.761897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b241e-8e61-4d03-b864-23c338fbb690 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:09.774734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:09.777122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 420/822] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:09.801428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94065c48-9059-4f6c-9a34-c0982e596464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:09.802046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94065c48-9059-4f6c-9a34-c0982e596464 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.802328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94065c48-9059-4f6c-9a34-c0982e596464 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.802600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94065c48-9059-4f6c-9a34-c0982e596464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.880491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94065c48-9059-4f6c-9a34-c0982e596464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:09.882291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94065c48-9059-4f6c-9a34-c0982e596464 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:09.994301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 403/823] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:22:09.995729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08bfd3-efcd-490c-b186-8053c181f768 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.090673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:10.109478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94065c48-9059-4f6c-9a34-c0982e596464 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.123875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:10.178674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08bfd3-efcd-490c-b186-8053c181f768 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:10.246669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c956b4-7fa0-49c8-a4a5-29507432ae25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:10.247840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c956b4-7fa0-49c8-a4a5-29507432ae25 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.248889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c956b4-7fa0-49c8-a4a5-29507432ae25 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.249749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c956b4-7fa0-49c8-a4a5-29507432ae25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.271462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c956b4-7fa0-49c8-a4a5-29507432ae25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:10.272926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c956b4-7fa0-49c8-a4a5-29507432ae25 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.288803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94065c48-9059-4f6c-9a34-c0982e596464 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-03c956b4-7fa0-49c8-a4a5-29507432ae25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:10.304023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:10.305023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:10.306326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:10.306326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:10.306326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:10.306326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 421/824] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:10.312900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c956b4-7fa0-49c8-a4a5-29507432ae25 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.363413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb203c59-ef18-486b-9ca6-c3cbe95fd8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:10.364099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb203c59-ef18-486b-9ca6-c3cbe95fd8fb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.364315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb203c59-ef18-486b-9ca6-c3cbe95fd8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.364584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb203c59-ef18-486b-9ca6-c3cbe95fd8fb None admin] PATH_INFO: `/v3/services/network` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.365165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb203c59-ef18-486b-9ca6-c3cbe95fd8fb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:10.367160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb203c59-ef18-486b-9ca6-c3cbe95fd8fb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fb203c59-ef18-486b-9ca6-c3cbe95fd8fb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:10.382016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:10.383114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 11:22:10.383963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:10.387254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 404/825] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:10 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:10.393638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb203c59-ef18-486b-9ca6-c3cbe95fd8fb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.440104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c956b4-7fa0-49c8-a4a5-29507432ae25 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:10.443235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:10.497784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695ce91-1fb6-436b-91c2-b10ee581f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:10.498355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ce91-1fb6-436b-91c2-b10ee581f170 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.498636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ce91-1fb6-436b-91c2-b10ee581f170 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.499899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ce91-1fb6-436b-91c2-b10ee581f170 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.500555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695ce91-1fb6-436b-91c2-b10ee581f170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:10.500861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695ce91-1fb6-436b-91c2-b10ee581f170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:10.502242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695ce91-1fb6-436b-91c2-b10ee581f170 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.513666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:10.527325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 422/826] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:10.532420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695ce91-1fb6-436b-91c2-b10ee581f170 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.568317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb203c59-ef18-486b-9ca6-c3cbe95fd8fb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:10.636810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f1e0c-fe71-4b94-bed1-56095b0515c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:10.637430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f1e0c-fe71-4b94-bed1-56095b0515c9 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.637709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f1e0c-fe71-4b94-bed1-56095b0515c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.637986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f1e0c-fe71-4b94-bed1-56095b0515c9 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.638630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f1e0c-fe71-4b94-bed1-56095b0515c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:10.639028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f1e0c-fe71-4b94-bed1-56095b0515c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:10.640521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f1e0c-fe71-4b94-bed1-56095b0515c9 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.650069 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 405/827] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:10.651354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f1e0c-fe71-4b94-bed1-56095b0515c9 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.733364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695ce91-1fb6-436b-91c2-b10ee581f170 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:10.771880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f1e0c-fe71-4b94-bed1-56095b0515c9 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:10.781952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6064fb-f197-4e35-bd50-08a5a2c10fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:10.783251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6064fb-f197-4e35-bd50-08a5a2c10fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.783950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6064fb-f197-4e35-bd50-08a5a2c10fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.784395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6064fb-f197-4e35-bd50-08a5a2c10fe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.794078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6064fb-f197-4e35-bd50-08a5a2c10fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:10.796511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6064fb-f197-4e35-bd50-08a5a2c10fe1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3d6064fb-f197-4e35-bd50-08a5a2c10fe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:10.809691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:10.811374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:10.813263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:10.813263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:10.813263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:10.813263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:10.813263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:10.813263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:10.813263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:10.813263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:10.814901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fcd55-eed5-436f-936f-0a3a411c61be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:10.815674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fcd55-eed5-436f-936f-0a3a411c61be None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.816076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fcd55-eed5-436f-936f-0a3a411c61be None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.816471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fcd55-eed5-436f-936f-0a3a411c61be None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.817229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fcd55-eed5-436f-936f-0a3a411c61be None admin] RBAC: Adding query filter params (type=network) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:10.817655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fcd55-eed5-436f-936f-0a3a411c61be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:10.818987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 423/828] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:10.819427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fcd55-eed5-436f-936f-0a3a411c61be None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.820566 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8c3bc-c6db-404e-b7f5-8fa98128eb44 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.821071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8c3bc-c6db-404e-b7f5-8fa98128eb44 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.821320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8c3bc-c6db-404e-b7f5-8fa98128eb44 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.827460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 424/829] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:10.827460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8c3bc-c6db-404e-b7f5-8fa98128eb44 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.831235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 406/830] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:10.833694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47709930-d0c3-487c-9130-798acf5a06b5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.834113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47709930-d0c3-487c-9130-798acf5a06b5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.834511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47709930-d0c3-487c-9130-798acf5a06b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.842565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:10.857259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-47709930-d0c3-487c-9130-798acf5a06b5 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:10.858645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-47709930-d0c3-487c-9130-798acf5a06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:10.863961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:10.938708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 407/831] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:10.938708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47709930-d0c3-487c-9130-798acf5a06b5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.987169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8c3bc-c6db-404e-b7f5-8fa98128eb44 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.066421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d9a34-ead4-4ea8-b30e-cc645ff35b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.067088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d9a34-ead4-4ea8-b30e-cc645ff35b9f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.067336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d9a34-ead4-4ea8-b30e-cc645ff35b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.067619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d9a34-ead4-4ea8-b30e-cc645ff35b9f None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.068330 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d9a34-ead4-4ea8-b30e-cc645ff35b9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:11.068637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d9a34-ead4-4ea8-b30e-cc645ff35b9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:11.072558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d9a34-ead4-4ea8-b30e-cc645ff35b9f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:11.096792 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 425/832] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:11.106894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47709930-d0c3-487c-9130-798acf5a06b5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.108515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d9a34-ead4-4ea8-b30e-cc645ff35b9f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:11.165566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:11.167635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c074f2-4807-4000-a991-dadf5b6db107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.168251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c074f2-4807-4000-a991-dadf5b6db107 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.168539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c074f2-4807-4000-a991-dadf5b6db107 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.168830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c074f2-4807-4000-a991-dadf5b6db107 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.169499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c074f2-4807-4000-a991-dadf5b6db107 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:11.172082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c074f2-4807-4000-a991-dadf5b6db107 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:11.202877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 408/833] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:11.254247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c074f2-4807-4000-a991-dadf5b6db107 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:11.296442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:11.324408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d9a34-ead4-4ea8-b30e-cc645ff35b9f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.402990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2002a2-db05-4e5d-9118-95dbbe783d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.403602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2002a2-db05-4e5d-9118-95dbbe783d0c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.404170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2002a2-db05-4e5d-9118-95dbbe783d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.404450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2002a2-db05-4e5d-9118-95dbbe783d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.405654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2002a2-db05-4e5d-9118-95dbbe783d0c None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=76462c2e1ec447acbd2aba9e77ae00b1) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:11.405965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2002a2-db05-4e5d-9118-95dbbe783d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:11.408367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2002a2-db05-4e5d-9118-95dbbe783d0c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:11.416007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 426/834] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:11 2022] GET /identity/v3/role_assignments?user.id=76462c2e1ec447acbd2aba9e77ae00b1&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=946af2ff291349299db56e09aacb6b03 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:11.447651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c074f2-4807-4000-a991-dadf5b6db107 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.495585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51223a70-c241-4e64-af46-f4bee29c2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.496308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223a70-c241-4e64-af46-f4bee29c2132 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.496589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223a70-c241-4e64-af46-f4bee29c2132 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.496858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223a70-c241-4e64-af46-f4bee29c2132 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.512365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51223a70-c241-4e64-af46-f4bee29c2132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-51223a70-c241-4e64-af46-f4bee29c2132 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:11.518566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:11.519633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:11.520708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 409/835] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:22:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:11.525744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2002a2-db05-4e5d-9118-95dbbe783d0c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:11.565918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f48bf-ad75-40e9-8fb3-dbf93b0b519d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.566151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f48bf-ad75-40e9-8fb3-dbf93b0b519d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.566387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f48bf-ad75-40e9-8fb3-dbf93b0b519d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.568953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 410/836] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:11.578794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e624dd2-792e-4bb1-a418-ef4dcece9ab1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.578794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e624dd2-792e-4bb1-a418-ef4dcece9ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.578794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e624dd2-792e-4bb1-a418-ef4dcece9ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.597577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9e624dd2-792e-4bb1-a418-ef4dcece9ab1 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:11.600646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9e624dd2-792e-4bb1-a418-ef4dcece9ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:11.653368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:11.681079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2002a2-db05-4e5d-9118-95dbbe783d0c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.683632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 411/837] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:11.724519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2442d7-d350-4cec-b3d4-516411e8cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.725889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2442d7-d350-4cec-b3d4-516411e8cc82 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.726572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2442d7-d350-4cec-b3d4-516411e8cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.727096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2442d7-d350-4cec-b3d4-516411e8cc82 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.728000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2442d7-d350-4cec-b3d4-516411e8cc82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:11.728504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2442d7-d350-4cec-b3d4-516411e8cc82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:11.730139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2442d7-d350-4cec-b3d4-516411e8cc82 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:11.739345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 427/838] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:22:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:11.746729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e624dd2-792e-4bb1-a418-ef4dcece9ab1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:11.848567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e624dd2-792e-4bb1-a418-ef4dcece9ab1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.887105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eea1cf-2f7f-4ecf-97bc-77708235fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.887728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eea1cf-2f7f-4ecf-97bc-77708235fa11 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.888002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eea1cf-2f7f-4ecf-97bc-77708235fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.888272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eea1cf-2f7f-4ecf-97bc-77708235fa11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.899249 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eea1cf-2f7f-4ecf-97bc-77708235fa11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:11.900705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eea1cf-2f7f-4ecf-97bc-77708235fa11 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c2eea1cf-2f7f-4ecf-97bc-77708235fa11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:11.916598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:11.917562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:11.918439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:11.918439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:11.918439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:11.918439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 412/839] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:11.924080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2442d7-d350-4cec-b3d4-516411e8cc82 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:11.935905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:11.975697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eea1cf-2f7f-4ecf-97bc-77708235fa11 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.009142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.036795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2442d7-d350-4cec-b3d4-516411e8cc82 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.072515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50b079-a1b3-42ac-983f-78dc88c3f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.073170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50b079-a1b3-42ac-983f-78dc88c3f173 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.073378 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50b079-a1b3-42ac-983f-78dc88c3f173 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.073645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50b079-a1b3-42ac-983f-78dc88c3f173 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.074324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50b079-a1b3-42ac-983f-78dc88c3f173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:12.074623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50b079-a1b3-42ac-983f-78dc88c3f173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.076013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50b079-a1b3-42ac-983f-78dc88c3f173 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.086834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eea1cf-2f7f-4ecf-97bc-77708235fa11 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.090722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 428/840] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:12.090722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2378f4a-f275-4a1f-8b47-539027dbe567 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.090722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2378f4a-f275-4a1f-8b47-539027dbe567 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.090722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2378f4a-f275-4a1f-8b47-539027dbe567 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.091618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 429/841] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:12.097370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2378f4a-f275-4a1f-8b47-539027dbe567 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.129914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0225b-c3c1-4ea6-94c4-61e67eca5edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.130466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0225b-c3c1-4ea6-94c4-61e67eca5edb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.130792 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0225b-c3c1-4ea6-94c4-61e67eca5edb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.131043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0225b-c3c1-4ea6-94c4-61e67eca5edb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.142787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0225b-c3c1-4ea6-94c4-61e67eca5edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-97d0225b-c3c1-4ea6-94c4-61e67eca5edb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:12.147989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:12.149105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 413/842] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:12.151683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfda25-88b2-47ed-acad-d91f3c46939e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.152449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfda25-88b2-47ed-acad-d91f3c46939e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.152449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfda25-88b2-47ed-acad-d91f3c46939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.169519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f2cfda25-88b2-47ed-acad-d91f3c46939e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:12.171001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f2cfda25-88b2-47ed-acad-d91f3c46939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:12.172396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.211393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2378f4a-f275-4a1f-8b47-539027dbe567 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.239745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 414/843] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:12.240898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfda25-88b2-47ed-acad-d91f3c46939e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.261699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bceb13-d6c8-4892-9b03-d6c5d58e5128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.262669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bceb13-d6c8-4892-9b03-d6c5d58e5128 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.263242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bceb13-d6c8-4892-9b03-d6c5d58e5128 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.264408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bceb13-d6c8-4892-9b03-d6c5d58e5128 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.271039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.273612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bceb13-d6c8-4892-9b03-d6c5d58e5128 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.276518 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bceb13-d6c8-4892-9b03-d6c5d58e5128 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-35bceb13-d6c8-4892-9b03-d6c5d58e5128 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:12.289580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:12.290543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:12.291528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:12.295068 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 430/844] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:12.296469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bceb13-d6c8-4892-9b03-d6c5d58e5128 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.372543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfda25-88b2-47ed-acad-d91f3c46939e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.408985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d87a-1a78-44b6-9140-980509694a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.409900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d87a-1a78-44b6-9140-980509694a00 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.410403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d87a-1a78-44b6-9140-980509694a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.410901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d87a-1a78-44b6-9140-980509694a00 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.411762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d87a-1a78-44b6-9140-980509694a00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:12.412266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d87a-1a78-44b6-9140-980509694a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.413896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d87a-1a78-44b6-9140-980509694a00 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.427457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 415/845] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:12.428579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d87a-1a78-44b6-9140-980509694a00 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.429969 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bceb13-d6c8-4892-9b03-d6c5d58e5128 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.465746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.478595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bdb6c-bd60-468e-8e3b-bdf882df2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.479231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bdb6c-bd60-468e-8e3b-bdf882df2ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.479512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bdb6c-bd60-468e-8e3b-bdf882df2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.479785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bdb6c-bd60-468e-8e3b-bdf882df2ab9 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.480533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bdb6c-bd60-468e-8e3b-bdf882df2ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:12.481084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bdb6c-bd60-468e-8e3b-bdf882df2ab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.483319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bdb6c-bd60-468e-8e3b-bdf882df2ab9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.512322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 431/846] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:12.518612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bdb6c-bd60-468e-8e3b-bdf882df2ab9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.543468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.566851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d87a-1a78-44b6-9140-980509694a00 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.604982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25199-04d6-4e8b-a6a7-6df9fe1b1291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.605612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25199-04d6-4e8b-a6a7-6df9fe1b1291 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.605894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25199-04d6-4e8b-a6a7-6df9fe1b1291 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.606170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25199-04d6-4e8b-a6a7-6df9fe1b1291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.617797 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e25199-04d6-4e8b-a6a7-6df9fe1b1291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.619286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e25199-04d6-4e8b-a6a7-6df9fe1b1291 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.629542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bdb6c-bd60-468e-8e3b-bdf882df2ab9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-14e25199-04d6-4e8b-a6a7-6df9fe1b1291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:12.635080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:12.636052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:12.642484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:12.642484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:12.642484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:12.642484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 416/847] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:12.642484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25199-04d6-4e8b-a6a7-6df9fe1b1291 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.677990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1ce7a-9d2c-4a4b-b914-b28e137d2dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.678606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1ce7a-9d2c-4a4b-b914-b28e137d2dee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.678922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1ce7a-9d2c-4a4b-b914-b28e137d2dee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.679885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1ce7a-9d2c-4a4b-b914-b28e137d2dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.743234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.761121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1ce7a-9d2c-4a4b-b914-b28e137d2dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.762589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1ce7a-9d2c-4a4b-b914-b28e137d2dee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.763084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25199-04d6-4e8b-a6a7-6df9fe1b1291 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.799370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cb62-57a2-41b9-85b0-e884ff891f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.799990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cb62-57a2-41b9-85b0-e884ff891f66 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.800266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cb62-57a2-41b9-85b0-e884ff891f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.800535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cb62-57a2-41b9-85b0-e884ff891f66 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.801107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4cb62-57a2-41b9-85b0-e884ff891f66 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.802466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4cb62-57a2-41b9-85b0-e884ff891f66 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.804446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-22a4cb62-57a2-41b9-85b0-e884ff891f66 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:12.813823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:12.814860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:12.815703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 417/848] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:12.817363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cb62-57a2-41b9-85b0-e884ff891f66 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.878519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 432/849] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:22:12.883115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1ce7a-9d2c-4a4b-b914-b28e137d2dee None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.928837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cb62-57a2-41b9-85b0-e884ff891f66 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.963388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192688bc-1bbe-45da-b557-8c77ca34a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.963991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192688bc-1bbe-45da-b557-8c77ca34a95b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.964272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192688bc-1bbe-45da-b557-8c77ca34a95b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.964551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192688bc-1bbe-45da-b557-8c77ca34a95b None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.965194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192688bc-1bbe-45da-b557-8c77ca34a95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:12.965498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192688bc-1bbe-45da-b557-8c77ca34a95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.966920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192688bc-1bbe-45da-b557-8c77ca34a95b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.973605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.979833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 418/850] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:12.980770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192688bc-1bbe-45da-b557-8c77ca34a95b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.997657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1ce7a-9d2c-4a4b-b914-b28e137d2dee None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.035934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa48cb-8d65-4a9e-8f08-43832b565c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.036535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa48cb-8d65-4a9e-8f08-43832b565c1e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.036811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa48cb-8d65-4a9e-8f08-43832b565c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.037082 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa48cb-8d65-4a9e-8f08-43832b565c1e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.037709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa48cb-8d65-4a9e-8f08-43832b565c1e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:13.038011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa48cb-8d65-4a9e-8f08-43832b565c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.039405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa48cb-8d65-4a9e-8f08-43832b565c1e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.040513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:13.044901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 433/851] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:13.047153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa48cb-8d65-4a9e-8f08-43832b565c1e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.089026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192688bc-1bbe-45da-b557-8c77ca34a95b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.125274 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc788d3-6119-410a-a1fd-eb23ef9c57be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.125898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc788d3-6119-410a-a1fd-eb23ef9c57be None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.126175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc788d3-6119-410a-a1fd-eb23ef9c57be None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.126445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc788d3-6119-410a-a1fd-eb23ef9c57be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.137066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc788d3-6119-410a-a1fd-eb23ef9c57be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.138501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc788d3-6119-410a-a1fd-eb23ef9c57be None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-2bc788d3-6119-410a-a1fd-eb23ef9c57be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:13.154270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:13.155967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:13.156873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:13.156873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:13.156873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:13.156873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 419/852] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:13.157119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc788d3-6119-410a-a1fd-eb23ef9c57be None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.172925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa48cb-8d65-4a9e-8f08-43832b565c1e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.207332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4876c82-4a8d-4402-a711-5e66966c5320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.207883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4876c82-4a8d-4402-a711-5e66966c5320 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.208162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4876c82-4a8d-4402-a711-5e66966c5320 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.208438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4876c82-4a8d-4402-a711-5e66966c5320 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.215618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4876c82-4a8d-4402-a711-5e66966c5320 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.217697 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4876c82-4a8d-4402-a711-5e66966c5320 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c4876c82-4a8d-4402-a711-5e66966c5320 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:13.229787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:13.230815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 434/853] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:13.231995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4876c82-4a8d-4402-a711-5e66966c5320 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.246562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:13.281399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc788d3-6119-410a-a1fd-eb23ef9c57be None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.292165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:13.316948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b91257-90df-4cbb-8d58-478454620b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.317554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b91257-90df-4cbb-8d58-478454620b80 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.317835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b91257-90df-4cbb-8d58-478454620b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.318112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b91257-90df-4cbb-8d58-478454620b80 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.318772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b91257-90df-4cbb-8d58-478454620b80 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:13.319078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b91257-90df-4cbb-8d58-478454620b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.320450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b91257-90df-4cbb-8d58-478454620b80 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.325798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 420/854] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:13.326868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b91257-90df-4cbb-8d58-478454620b80 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.358278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4876c82-4a8d-4402-a711-5e66966c5320 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.402323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa98e-9a8c-4893-be02-d28d966beba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.403452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa98e-9a8c-4893-be02-d28d966beba5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.404047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa98e-9a8c-4893-be02-d28d966beba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.404621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa98e-9a8c-4893-be02-d28d966beba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.405603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa98e-9a8c-4893-be02-d28d966beba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:13.406158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa98e-9a8c-4893-be02-d28d966beba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.407964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa98e-9a8c-4893-be02-d28d966beba5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.423417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 435/855] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:13.430729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa98e-9a8c-4893-be02-d28d966beba5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.442990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b91257-90df-4cbb-8d58-478454620b80 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.480856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee4648-65f1-4d03-b68b-d8f163846202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.481410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee4648-65f1-4d03-b68b-d8f163846202 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.481696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee4648-65f1-4d03-b68b-d8f163846202 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.481953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee4648-65f1-4d03-b68b-d8f163846202 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.483306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee4648-65f1-4d03-b68b-d8f163846202 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:13.483834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee4648-65f1-4d03-b68b-d8f163846202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.485277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee4648-65f1-4d03-b68b-d8f163846202 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.506312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 421/856] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:13.510709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:13.512510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee4648-65f1-4d03-b68b-d8f163846202 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.549466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa98e-9a8c-4893-be02-d28d966beba5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.555098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:13.585547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edbf3f-1091-4c1f-ae88-d439ec7ee5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.586178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edbf3f-1091-4c1f-ae88-d439ec7ee5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.586460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edbf3f-1091-4c1f-ae88-d439ec7ee5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.586763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edbf3f-1091-4c1f-ae88-d439ec7ee5a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.593927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edbf3f-1091-4c1f-ae88-d439ec7ee5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.595423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edbf3f-1091-4c1f-ae88-d439ec7ee5a5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-57edbf3f-1091-4c1f-ae88-d439ec7ee5a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:13.607045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:13.608527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:13.609720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:13.609720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:13.609720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:13.609720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:13.609720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:13.609720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:13.609720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:13.609720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:13.609720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 436/857] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:13.610322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4901d-f22d-4721-85ca-36d668d2b6d9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.610322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4901d-f22d-4721-85ca-36d668d2b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.610478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4901d-f22d-4721-85ca-36d668d2b6d9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.611760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 437/858] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:13.614054 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4901d-f22d-4721-85ca-36d668d2b6d9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.637867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee4648-65f1-4d03-b68b-d8f163846202 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.673977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72feac3-8311-4a1d-8655-42534d68a640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.674587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72feac3-8311-4a1d-8655-42534d68a640 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.674893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72feac3-8311-4a1d-8655-42534d68a640 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.675156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72feac3-8311-4a1d-8655-42534d68a640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.739523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4901d-f22d-4721-85ca-36d668d2b6d9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.746101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72feac3-8311-4a1d-8655-42534d68a640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.747616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72feac3-8311-4a1d-8655-42534d68a640 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.768592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:13.777390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286145b-72a0-4c4b-8bd9-59903d14524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.778158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286145b-72a0-4c4b-8bd9-59903d14524a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.778749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:13.778863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286145b-72a0-4c4b-8bd9-59903d14524a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.780623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286145b-72a0-4c4b-8bd9-59903d14524a None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.781574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286145b-72a0-4c4b-8bd9-59903d14524a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:13.781889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286145b-72a0-4c4b-8bd9-59903d14524a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.783481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286145b-72a0-4c4b-8bd9-59903d14524a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.796393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 438/859] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:13.797676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283361f-86b3-4f0b-9abf-f93beddf3c95 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.797960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283361f-86b3-4f0b-9abf-f93beddf3c95 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.798236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283361f-86b3-4f0b-9abf-f93beddf3c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.817754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a283361f-86b3-4f0b-9abf-f93beddf3c95 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:13.818962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a283361f-86b3-4f0b-9abf-f93beddf3c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:13.865322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 422/860] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:22:13.867766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72feac3-8311-4a1d-8655-42534d68a640 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.891876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 439/861] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:13.892644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283361f-86b3-4f0b-9abf-f93beddf3c95 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.001224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72feac3-8311-4a1d-8655-42534d68a640 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.036050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283361f-86b3-4f0b-9abf-f93beddf3c95 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.041520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:14.048444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58788d0b-6943-4f7b-bb28-412005928a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.048688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58788d0b-6943-4f7b-bb28-412005928a51 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.048943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58788d0b-6943-4f7b-bb28-412005928a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.049211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58788d0b-6943-4f7b-bb28-412005928a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.049934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58788d0b-6943-4f7b-bb28-412005928a51 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=660b505867744099a74f3ade6bad2d86) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:14.050236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58788d0b-6943-4f7b-bb28-412005928a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.051757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58788d0b-6943-4f7b-bb28-412005928a51 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.059845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 423/862] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/role_assignments?user.id=660b505867744099a74f3ade6bad2d86&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:14.062921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:14.085037 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9626aa-c2ce-49cb-aa7d-cef31334960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.086088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9626aa-c2ce-49cb-aa7d-cef31334960f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.086573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9626aa-c2ce-49cb-aa7d-cef31334960f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.087084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9626aa-c2ce-49cb-aa7d-cef31334960f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.099890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9626aa-c2ce-49cb-aa7d-cef31334960f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.101717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9626aa-c2ce-49cb-aa7d-cef31334960f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fa9626aa-c2ce-49cb-aa7d-cef31334960f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:14.118809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:14.119841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:14.120731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:14.120731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:14.120731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:14.123044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 440/863] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:14.130829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58788d0b-6943-4f7b-bb28-412005928a51 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.179775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9626aa-c2ce-49cb-aa7d-cef31334960f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.273177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58788d0b-6943-4f7b-bb28-412005928a51 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.310281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9626aa-c2ce-49cb-aa7d-cef31334960f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.318795 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6621b-40fa-4d3c-a6d4-93ffc7fc5940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.319691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6621b-40fa-4d3c-a6d4-93ffc7fc5940 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.320199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6621b-40fa-4d3c-a6d4-93ffc7fc5940 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.320676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6621b-40fa-4d3c-a6d4-93ffc7fc5940 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.321543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6621b-40fa-4d3c-a6d4-93ffc7fc5940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:14.321845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6621b-40fa-4d3c-a6d4-93ffc7fc5940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.323284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6621b-40fa-4d3c-a6d4-93ffc7fc5940 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.341028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 424/864] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:14.342820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6621b-40fa-4d3c-a6d4-93ffc7fc5940 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.351934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b8b7f-bb4f-4a8e-abf3-cde5413a41cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.352662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b8b7f-bb4f-4a8e-abf3-cde5413a41cb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.353015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b8b7f-bb4f-4a8e-abf3-cde5413a41cb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.353360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b8b7f-bb4f-4a8e-abf3-cde5413a41cb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.354031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b8b7f-bb4f-4a8e-abf3-cde5413a41cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.355618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b8b7f-bb4f-4a8e-abf3-cde5413a41cb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ab2b8b7f-bb4f-4a8e-abf3-cde5413a41cb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:14.365903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:14.366897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:14.368070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 441/865] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 31 11:22:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:14.373983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b8b7f-bb4f-4a8e-abf3-cde5413a41cb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.411657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:14.417379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:14.478205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6621b-40fa-4d3c-a6d4-93ffc7fc5940 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.493570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b8b7f-bb4f-4a8e-abf3-cde5413a41cb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.524211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fc362-23e9-4a2d-bedf-ff78577fa0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.525724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fc362-23e9-4a2d-bedf-ff78577fa0bb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.526217 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fc362-23e9-4a2d-bedf-ff78577fa0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.526940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fc362-23e9-4a2d-bedf-ff78577fa0bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.536728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fc362-23e9-4a2d-bedf-ff78577fa0bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.537553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229973fc-6e65-4ab8-89a3-672e8c341b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.538266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229973fc-6e65-4ab8-89a3-672e8c341b21 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.538645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229973fc-6e65-4ab8-89a3-672e8c341b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.538928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fc362-23e9-4a2d-bedf-ff78577fa0bb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.539134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229973fc-6e65-4ab8-89a3-672e8c341b21 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.539864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229973fc-6e65-4ab8-89a3-672e8c341b21 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:14.540269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229973fc-6e65-4ab8-89a3-672e8c341b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.542424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229973fc-6e65-4ab8-89a3-672e8c341b21 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.552716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 442/866] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-1f2fc362-23e9-4a2d-bedf-ff78577fa0bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:14.553124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:14.554157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:14.555120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:14.555120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:14.555120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:14.555120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:14.555120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:14.555120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:14.555120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:14.555120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:14.555980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229973fc-6e65-4ab8-89a3-672e8c341b21 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.558074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 425/867] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:14.563772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fc362-23e9-4a2d-bedf-ff78577fa0bb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.662604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:14.673870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229973fc-6e65-4ab8-89a3-672e8c341b21 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.674838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fc362-23e9-4a2d-bedf-ff78577fa0bb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.693038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:14.714381 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef462bf7-14e4-4f86-b62f-01f2f4bb4160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.715385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef462bf7-14e4-4f86-b62f-01f2f4bb4160 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.715932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef462bf7-14e4-4f86-b62f-01f2f4bb4160 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.716406 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef462bf7-14e4-4f86-b62f-01f2f4bb4160 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.717341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef462bf7-14e4-4f86-b62f-01f2f4bb4160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:14.717868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef462bf7-14e4-4f86-b62f-01f2f4bb4160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.719222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e0080-9eb1-484b-90d0-e2bd16bc4d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.719831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0080-9eb1-484b-90d0-e2bd16bc4d2b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.720079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef462bf7-14e4-4f86-b62f-01f2f4bb4160 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.720194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0080-9eb1-484b-90d0-e2bd16bc4d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.720365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0080-9eb1-484b-90d0-e2bd16bc4d2b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.720995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e0080-9eb1-484b-90d0-e2bd16bc4d2b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:14.721294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e0080-9eb1-484b-90d0-e2bd16bc4d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.722956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e0080-9eb1-484b-90d0-e2bd16bc4d2b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.734727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 443/868] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:14.741383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 426/869] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:14.747473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e0080-9eb1-484b-90d0-e2bd16bc4d2b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.863743 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e0080-9eb1-484b-90d0-e2bd16bc4d2b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.903230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb4f26-acf6-4d73-a6e3-9ae60b1f3903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.903823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb4f26-acf6-4d73-a6e3-9ae60b1f3903 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.904102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb4f26-acf6-4d73-a6e3-9ae60b1f3903 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.904370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb4f26-acf6-4d73-a6e3-9ae60b1f3903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.905497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb4f26-acf6-4d73-a6e3-9ae60b1f3903 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=a1966d24e4cf4a46b71dc2ec302a8d27) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:14.905868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb4f26-acf6-4d73-a6e3-9ae60b1f3903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.907354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb4f26-acf6-4d73-a6e3-9ae60b1f3903 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.913639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 444/870] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:14 2022] GET /identity/v3/role_assignments?user.id=a1966d24e4cf4a46b71dc2ec302a8d27&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=946af2ff291349299db56e09aacb6b03 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:15.298216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01a491-a525-4102-9115-b4d272e58a0d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:15.298590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01a491-a525-4102-9115-b4d272e58a0d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:15.298792 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01a491-a525-4102-9115-b4d272e58a0d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:15.300384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 427/871] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:15.305576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1388756-c5a0-4b56-bfbe-ebe213678c9b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:15.306020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1388756-c5a0-4b56-bfbe-ebe213678c9b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:15.306099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1388756-c5a0-4b56-bfbe-ebe213678c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:15.324278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d1388756-c5a0-4b56-bfbe-ebe213678c9b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:15.325446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d1388756-c5a0-4b56-bfbe-ebe213678c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:15.347674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:15.397271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 445/872] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:15.666876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01a491-a525-4102-9115-b4d272e58a0d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:15.773029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01a491-a525-4102-9115-b4d272e58a0d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:15.811798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e74c60-ef99-462a-871b-2eb48f9e3295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:15.812413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e74c60-ef99-462a-871b-2eb48f9e3295 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:15.812692 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e74c60-ef99-462a-871b-2eb48f9e3295 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:15.812967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e74c60-ef99-462a-871b-2eb48f9e3295 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:15.813640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e74c60-ef99-462a-871b-2eb48f9e3295 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:15.815040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e74c60-ef99-462a-871b-2eb48f9e3295 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:15.833203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 428/873] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:22:15 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:16.137909 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a189a5-4810-4cda-b129-caff9511b957 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:16.138310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a189a5-4810-4cda-b129-caff9511b957 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:16.138488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a189a5-4810-4cda-b129-caff9511b957 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:16.140789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 446/874] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:16.146173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865515b8-9f6a-4e36-a78c-137733b75c6c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:16.146461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865515b8-9f6a-4e36-a78c-137733b75c6c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:16.146766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865515b8-9f6a-4e36-a78c-137733b75c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:16.165246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-865515b8-9f6a-4e36-a78c-137733b75c6c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:16.166436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-865515b8-9f6a-4e36-a78c-137733b75c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:16.196537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:16.242880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 429/875] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:16.512593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a189a5-4810-4cda-b129-caff9511b957 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:16.621041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a189a5-4810-4cda-b129-caff9511b957 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:16.656498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4917e-9225-4d17-ae5c-60e5f4eb02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:16.657136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4917e-9225-4d17-ae5c-60e5f4eb02bb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:16.657417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4917e-9225-4d17-ae5c-60e5f4eb02bb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:16.657689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4917e-9225-4d17-ae5c-60e5f4eb02bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:16.678704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4917e-9225-4d17-ae5c-60e5f4eb02bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2aa4917e-9225-4d17-ae5c-60e5f4eb02bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:16.681345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:16.682279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:16.683402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 447/876] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 31 11:22:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:16.689237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865515b8-9f6a-4e36-a78c-137733b75c6c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:16.730297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e739f-7108-4f84-916d-ef0d24991b6b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:16.730882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e739f-7108-4f84-916d-ef0d24991b6b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:16.731306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e739f-7108-4f84-916d-ef0d24991b6b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:16.734039 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 448/877] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:16.739338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5076ce-439b-4ee8-8ca2-61a3ecf2a15f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:16.739867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5076ce-439b-4ee8-8ca2-61a3ecf2a15f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:16.740341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5076ce-439b-4ee8-8ca2-61a3ecf2a15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:16.759135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bf5076ce-439b-4ee8-8ca2-61a3ecf2a15f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:16.760418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bf5076ce-439b-4ee8-8ca2-61a3ecf2a15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:16.778743 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:16.793599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865515b8-9f6a-4e36-a78c-137733b75c6c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:16.836079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4fc4-a38b-4f6d-9255-723c972982ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:16.837206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4fc4-a38b-4f6d-9255-723c972982ec None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:16.837958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4fc4-a38b-4f6d-9255-723c972982ec None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:16.838417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4fc4-a38b-4f6d-9255-723c972982ec None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:16.839540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a4fc4-a38b-4f6d-9255-723c972982ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:16.840028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a4fc4-a38b-4f6d-9255-723c972982ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:16.841767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a4fc4-a38b-4f6d-9255-723c972982ec None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:16.850796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 449/878] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:16.852301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 430/879] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 31 11:22:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:16.863838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5076ce-439b-4ee8-8ca2-61a3ecf2a15f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.014028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5076ce-439b-4ee8-8ca2-61a3ecf2a15f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:17.017077 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1fb0c-e42d-4c8d-a90d-197795f8fa4e None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.017362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1fb0c-e42d-4c8d-a90d-197795f8fa4e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.017636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1fb0c-e42d-4c8d-a90d-197795f8fa4e None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.019146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 431/880] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:17.023769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430ac5c-dd51-4de8-9796-73970b2f9acc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.024052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430ac5c-dd51-4de8-9796-73970b2f9acc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.024326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430ac5c-dd51-4de8-9796-73970b2f9acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.056389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d430ac5c-dd51-4de8-9796-73970b2f9acc None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:17.059054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d430ac5c-dd51-4de8-9796-73970b2f9acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:17.104039 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4c44b-25e8-4e09-804f-409b6f164cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:17.104700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4c44b-25e8-4e09-804f-409b6f164cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.104984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4c44b-25e8-4e09-804f-409b6f164cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.105267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4c44b-25e8-4e09-804f-409b6f164cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.115107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:17.119109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4c44b-25e8-4e09-804f-409b6f164cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:17.120586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4c44b-25e8-4e09-804f-409b6f164cc1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:17.142893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5aa4c44b-25e8-4e09-804f-409b6f164cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:17.158164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:17.159167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:17.160058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:17.160058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:17.160058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:17.163578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 450/881] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:17.164659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4c44b-25e8-4e09-804f-409b6f164cc1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.198717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 432/882] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:17.198717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430ac5c-dd51-4de8-9796-73970b2f9acc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.285263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4c44b-25e8-4e09-804f-409b6f164cc1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:17.334718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99baa958-2a7f-4723-aa9f-15a993c814a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:17.336794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baa958-2a7f-4723-aa9f-15a993c814a6 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.336794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baa958-2a7f-4723-aa9f-15a993c814a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.336794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baa958-2a7f-4723-aa9f-15a993c814a6 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.336794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99baa958-2a7f-4723-aa9f-15a993c814a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:17.338382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99baa958-2a7f-4723-aa9f-15a993c814a6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:17.365552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 451/883] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:22:17 2022] POST /identity/v3/services => generated 269 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:17.379590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430ac5c-dd51-4de8-9796-73970b2f9acc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:17.428449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425303d2-05f7-4926-bda0-a7c4f4b7caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:17.429077 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425303d2-05f7-4926-bda0-a7c4f4b7caa6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.429356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425303d2-05f7-4926-bda0-a7c4f4b7caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.429625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425303d2-05f7-4926-bda0-a7c4f4b7caa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.430289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425303d2-05f7-4926-bda0-a7c4f4b7caa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:17.430591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425303d2-05f7-4926-bda0-a7c4f4b7caa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:17.432051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425303d2-05f7-4926-bda0-a7c4f4b7caa6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:17.446591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 433/884] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:17.452871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99baa958-2a7f-4723-aa9f-15a993c814a6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.499594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425303d2-05f7-4926-bda0-a7c4f4b7caa6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.514527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:17.531435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:17.586410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99baa958-2a7f-4723-aa9f-15a993c814a6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:17.633255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425303d2-05f7-4926-bda0-a7c4f4b7caa6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:17.636437 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdf148-32af-406f-8128-b6a4fef2a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:17.637246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdf148-32af-406f-8128-b6a4fef2a43c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.637672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdf148-32af-406f-8128-b6a4fef2a43c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.638089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdf148-32af-406f-8128-b6a4fef2a43c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.648170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdf148-32af-406f-8128-b6a4fef2a43c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:17.650471 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdf148-32af-406f-8128-b6a4fef2a43c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-41bdf148-32af-406f-8128-b6a4fef2a43c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:17.666715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:17.667876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:17.669019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:17.672069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 452/885] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:22:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:17.678243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdf148-32af-406f-8128-b6a4fef2a43c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.683720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36470134-c124-404c-b42d-3e19c96c0b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:17.684369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36470134-c124-404c-b42d-3e19c96c0b6c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.684649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36470134-c124-404c-b42d-3e19c96c0b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.684923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36470134-c124-404c-b42d-3e19c96c0b6c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.685513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36470134-c124-404c-b42d-3e19c96c0b6c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:17.686987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36470134-c124-404c-b42d-3e19c96c0b6c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-36470134-c124-404c-b42d-3e19c96c0b6c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:17.698423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:17.699952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:17.700807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:17.703052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 434/886] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:17.707367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36470134-c124-404c-b42d-3e19c96c0b6c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.797695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:17.809449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdf148-32af-406f-8128-b6a4fef2a43c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:17.828385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:17.828884 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36470134-c124-404c-b42d-3e19c96c0b6c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:17.849653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4c6b5-625c-4d40-aa5b-5c14b49e920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:17.850191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c6b5-625c-4d40-aa5b-5c14b49e920c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.850480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c6b5-625c-4d40-aa5b-5c14b49e920c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.850784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c6b5-625c-4d40-aa5b-5c14b49e920c None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.851963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4c6b5-625c-4d40-aa5b-5c14b49e920c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:17.852561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4c6b5-625c-4d40-aa5b-5c14b49e920c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:17.854506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4c6b5-625c-4d40-aa5b-5c14b49e920c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:17.865191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d61f7-f0c0-4b01-8f52-0ff24502ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:17.865805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d61f7-f0c0-4b01-8f52-0ff24502ab87 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.866077 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d61f7-f0c0-4b01-8f52-0ff24502ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.866344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d61f7-f0c0-4b01-8f52-0ff24502ab87 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.867003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d61f7-f0c0-4b01-8f52-0ff24502ab87 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:17.867303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d61f7-f0c0-4b01-8f52-0ff24502ab87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:17.868655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d61f7-f0c0-4b01-8f52-0ff24502ab87 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:17.873788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 435/887] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:17.875162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e297bc3-947f-4054-9679-d6e1d68da93d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.875439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e297bc3-947f-4054-9679-d6e1d68da93d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.875708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e297bc3-947f-4054-9679-d6e1d68da93d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.880918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 453/889] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 31 11:22:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:17.881060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 436/889] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:17.881708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e297bc3-947f-4054-9679-d6e1d68da93d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.882635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50184b27-6dfd-4f27-9683-778ce6c640cb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.882953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50184b27-6dfd-4f27-9683-778ce6c640cb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.883229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50184b27-6dfd-4f27-9683-778ce6c640cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.905334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-50184b27-6dfd-4f27-9683-778ce6c640cb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:17.906812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-50184b27-6dfd-4f27-9683-778ce6c640cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:17.985676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 454/890] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:17.986537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50184b27-6dfd-4f27-9683-778ce6c640cb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.000298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e297bc3-947f-4054-9679-d6e1d68da93d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.038206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501abe9b-c282-4764-be17-664eb2433850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.039210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501abe9b-c282-4764-be17-664eb2433850 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.039687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501abe9b-c282-4764-be17-664eb2433850 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.040265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501abe9b-c282-4764-be17-664eb2433850 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.041177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501abe9b-c282-4764-be17-664eb2433850 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:18.041682 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501abe9b-c282-4764-be17-664eb2433850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.043272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501abe9b-c282-4764-be17-664eb2433850 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.049157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 437/891] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:18.106103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50184b27-6dfd-4f27-9683-778ce6c640cb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.115587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:18.147436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6e9ca-7194-4293-b5ee-655417ea5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.148476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6e9ca-7194-4293-b5ee-655417ea5065 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.148959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6e9ca-7194-4293-b5ee-655417ea5065 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.149430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6e9ca-7194-4293-b5ee-655417ea5065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.225290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6e9ca-7194-4293-b5ee-655417ea5065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.227193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6e9ca-7194-4293-b5ee-655417ea5065 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.260975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501abe9b-c282-4764-be17-664eb2433850 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.264478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:18.354717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 455/892] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:17 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:22:18.359843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6e9ca-7194-4293-b5ee-655417ea5065 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.370653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:18.373872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501abe9b-c282-4764-be17-664eb2433850 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.412751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38eeb79-9fdb-4ef7-b538-ec639a917595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.413681 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eeb79-9fdb-4ef7-b538-ec639a917595 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.413796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eeb79-9fdb-4ef7-b538-ec639a917595 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.414065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eeb79-9fdb-4ef7-b538-ec639a917595 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.414654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38eeb79-9fdb-4ef7-b538-ec639a917595 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.416082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38eeb79-9fdb-4ef7-b538-ec639a917595 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-a38eeb79-9fdb-4ef7-b538-ec639a917595 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:18.426110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:18.427159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 11:22:18.428276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:18.432641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 438/893] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:22:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:18.433633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38eeb79-9fdb-4ef7-b538-ec639a917595 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.501341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6e9ca-7194-4293-b5ee-655417ea5065 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.506026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:18.548137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba4e0-10f1-4b89-87e5-357b83923412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.548876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba4e0-10f1-4b89-87e5-357b83923412 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.549078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba4e0-10f1-4b89-87e5-357b83923412 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.549529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba4e0-10f1-4b89-87e5-357b83923412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.551923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38eeb79-9fdb-4ef7-b538-ec639a917595 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.562895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba4e0-10f1-4b89-87e5-357b83923412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.564742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba4e0-10f1-4b89-87e5-357b83923412 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8a0ba4e0-10f1-4b89-87e5-357b83923412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:18.584489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:18.585477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:18.586367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:18.586367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:18.586367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:18.588070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 456/894] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:18.591066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba4e0-10f1-4b89-87e5-357b83923412 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.598542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432412-6a6c-4046-8516-125b438902d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.599365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432412-6a6c-4046-8516-125b438902d6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.599651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432412-6a6c-4046-8516-125b438902d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.599925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432412-6a6c-4046-8516-125b438902d6 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.600561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432412-6a6c-4046-8516-125b438902d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:18.600859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432412-6a6c-4046-8516-125b438902d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.602241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432412-6a6c-4046-8516-125b438902d6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.610845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 439/895] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:22:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:18.614866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432412-6a6c-4046-8516-125b438902d6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.678576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:18.740763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba4e0-10f1-4b89-87e5-357b83923412 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.757445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432412-6a6c-4046-8516-125b438902d6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.776597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaea3d-a070-4c4a-8bf6-dc52a0a31605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.777208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaea3d-a070-4c4a-8bf6-dc52a0a31605 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.777486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaea3d-a070-4c4a-8bf6-dc52a0a31605 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.777765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaea3d-a070-4c4a-8bf6-dc52a0a31605 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.778426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaea3d-a070-4c4a-8bf6-dc52a0a31605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:18.778723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaea3d-a070-4c4a-8bf6-dc52a0a31605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.780826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaea3d-a070-4c4a-8bf6-dc52a0a31605 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.794740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 457/896] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:18.797020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:18.800886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaea3d-a070-4c4a-8bf6-dc52a0a31605 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.805651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3ddfc-25fd-4184-b2f8-7d764f2c8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.806508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3ddfc-25fd-4184-b2f8-7d764f2c8863 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.807065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3ddfc-25fd-4184-b2f8-7d764f2c8863 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.807562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3ddfc-25fd-4184-b2f8-7d764f2c8863 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.808391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3ddfc-25fd-4184-b2f8-7d764f2c8863 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:18.808893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3ddfc-25fd-4184-b2f8-7d764f2c8863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.811122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3ddfc-25fd-4184-b2f8-7d764f2c8863 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.818896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 440/897] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:22:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:18.825935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3ddfc-25fd-4184-b2f8-7d764f2c8863 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.915569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaea3d-a070-4c4a-8bf6-dc52a0a31605 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.935045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:18.937576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3ddfc-25fd-4184-b2f8-7d764f2c8863 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.956015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca01a2-efaf-4fd5-8787-caf60ccec60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.956881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca01a2-efaf-4fd5-8787-caf60ccec60c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.956984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca01a2-efaf-4fd5-8787-caf60ccec60c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.957280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca01a2-efaf-4fd5-8787-caf60ccec60c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.965089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca01a2-efaf-4fd5-8787-caf60ccec60c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.966430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca01a2-efaf-4fd5-8787-caf60ccec60c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.976635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d006e-da6a-45ca-9b75-caba874e81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.977505 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d006e-da6a-45ca-9b75-caba874e81ae None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.977986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d006e-da6a-45ca-9b75-caba874e81ae None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.978457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d006e-da6a-45ca-9b75-caba874e81ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.979391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d006e-da6a-45ca-9b75-caba874e81ae None admin] RBAC: Adding query filter params (interface=public, service_id=1266a4766db042ad99e7eb8141f4c64e, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-23ca01a2-efaf-4fd5-8787-caf60ccec60c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:18.979798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:18.980679 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:18.981573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:18.981573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:18.981573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:18.981573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:18.981573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:18.981573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:18.981573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:18.981573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:18.981573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 458/898] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:18.982835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d006e-da6a-45ca-9b75-caba874e81ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.984486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d006e-da6a-45ca-9b75-caba874e81ae None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.986830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca01a2-efaf-4fd5-8787-caf60ccec60c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.990880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 441/899] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 31 11:22:18 2022] GET /identity/v3/endpoints?service_id=1266a4766db042ad99e7eb8141f4c64e&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:19.001702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d006e-da6a-45ca-9b75-caba874e81ae None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:19.088519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:19.121572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca01a2-efaf-4fd5-8787-caf60ccec60c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:19.133003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d006e-da6a-45ca-9b75-caba874e81ae None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:19.158911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f790fb-3bdd-4ea3-a824-8100f0ddc1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:19.159521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f790fb-3bdd-4ea3-a824-8100f0ddc1ec None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:19.159802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f790fb-3bdd-4ea3-a824-8100f0ddc1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:19.160075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f790fb-3bdd-4ea3-a824-8100f0ddc1ec None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:19.160776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f790fb-3bdd-4ea3-a824-8100f0ddc1ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:19.161081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f790fb-3bdd-4ea3-a824-8100f0ddc1ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:19.162586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f790fb-3bdd-4ea3-a824-8100f0ddc1ec None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:19.180634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 459/900] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:19.181458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d2798-a976-4b78-a6fe-fcc724ff4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:19.182075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d2798-a976-4b78-a6fe-fcc724ff4dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:19.182352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d2798-a976-4b78-a6fe-fcc724ff4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:19.182624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d2798-a976-4b78-a6fe-fcc724ff4dc8 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:19.183303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d2798-a976-4b78-a6fe-fcc724ff4dc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:19.184667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d2798-a976-4b78-a6fe-fcc724ff4dc8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:19.187829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f790fb-3bdd-4ea3-a824-8100f0ddc1ec None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:19.198876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 442/901] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 31 11:22:18 2022] GET /identity/v3/services => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:19.239137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:19.312294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f790fb-3bdd-4ea3-a824-8100f0ddc1ec None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:19.351007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a4f84-c0dc-4635-a613-9c819161233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:19.351611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a4f84-c0dc-4635-a613-9c819161233f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:19.351885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a4f84-c0dc-4635-a613-9c819161233f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:19.352154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a4f84-c0dc-4635-a613-9c819161233f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:19.352870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a4f84-c0dc-4635-a613-9c819161233f None admin] RBAC: Adding query filter params (role.id=ca0823b45e484a0ca722ad52ab8804cf, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=660b505867744099a74f3ade6bad2d86) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:19.353175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a4f84-c0dc-4635-a613-9c819161233f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:19.354598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a4f84-c0dc-4635-a613-9c819161233f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:19.362086 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 460/902] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:19 2022] GET /identity/v3/role_assignments?user.id=660b505867744099a74f3ade6bad2d86&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=ca0823b45e484a0ca722ad52ab8804cf => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:19.414801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed687a-e678-46fb-a2a6-52e0c29dd50f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:19.415146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed687a-e678-46fb-a2a6-52e0c29dd50f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:19.415343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed687a-e678-46fb-a2a6-52e0c29dd50f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:19.417028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 443/903] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:19.423474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6c66-c819-4c28-a344-3dc853b12028 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:19.423779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6c66-c819-4c28-a344-3dc853b12028 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:19.424032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6c66-c819-4c28-a344-3dc853b12028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:19.445061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-29ef6c66-c819-4c28-a344-3dc853b12028 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:19.446203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-29ef6c66-c819-4c28-a344-3dc853b12028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:19.522901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 461/904] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:19.803263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed687a-e678-46fb-a2a6-52e0c29dd50f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:19.911919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed687a-e678-46fb-a2a6-52e0c29dd50f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:19.935869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:19.949060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52ead-3577-4cc9-8e62-aa9487c29b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:19.949991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52ead-3577-4cc9-8e62-aa9487c29b60 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:19.950491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52ead-3577-4cc9-8e62-aa9487c29b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:19.951037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52ead-3577-4cc9-8e62-aa9487c29b60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:19.951919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e52ead-3577-4cc9-8e62-aa9487c29b60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:19.953625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e52ead-3577-4cc9-8e62-aa9487c29b60 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-09e52ead-3577-4cc9-8e62-aa9487c29b60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:19.962913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:19.963864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 11:22:19.964775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:19.968232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 444/905] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 31 11:22:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:19.978741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef6c66-c819-4c28-a344-3dc853b12028 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:20.006536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:20.062110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9c58b-1c82-4d80-9269-823512aec7a6 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:20.062313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9c58b-1c82-4d80-9269-823512aec7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:20.062566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9c58b-1c82-4d80-9269-823512aec7a6 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:20.064088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 445/906] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:20.069146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29515b1-b546-4f5f-8018-33985898fb81 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:20.069648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29515b1-b546-4f5f-8018-33985898fb81 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:20.070141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29515b1-b546-4f5f-8018-33985898fb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:20.080746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef6c66-c819-4c28-a344-3dc853b12028 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:20.088816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f29515b1-b546-4f5f-8018-33985898fb81 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:20.090232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f29515b1-b546-4f5f-8018-33985898fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:20.116868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e7599-1110-47f4-94ba-e12a944e79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:20.117481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e7599-1110-47f4-94ba-e12a944e79b0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:20.117766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e7599-1110-47f4-94ba-e12a944e79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:20.118042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e7599-1110-47f4-94ba-e12a944e79b0 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:20.118815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e7599-1110-47f4-94ba-e12a944e79b0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:20.119220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e7599-1110-47f4-94ba-e12a944e79b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:20.120607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e7599-1110-47f4-94ba-e12a944e79b0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:20.126537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 462/907] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:20.132097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e7599-1110-47f4-94ba-e12a944e79b0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:20.162519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 446/908] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:20.238745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:20.245533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e7599-1110-47f4-94ba-e12a944e79b0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:20.288014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a940c2-fab9-4d13-b012-56601f427774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:20.288620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a940c2-fab9-4d13-b012-56601f427774 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:20.288895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a940c2-fab9-4d13-b012-56601f427774 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:20.289162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a940c2-fab9-4d13-b012-56601f427774 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:20.289797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a940c2-fab9-4d13-b012-56601f427774 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:20.290093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a940c2-fab9-4d13-b012-56601f427774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:20.291489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a940c2-fab9-4d13-b012-56601f427774 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:20.297650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 463/909] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:20.303789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29515b1-b546-4f5f-8018-33985898fb81 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:20.416948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29515b1-b546-4f5f-8018-33985898fb81 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:20.440195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:20.440876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a940c2-fab9-4d13-b012-56601f427774 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:20.456417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ebf72-ca1a-41e5-bc08-936ba09d7b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:20.457343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ebf72-ca1a-41e5-bc08-936ba09d7b7f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:20.457815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ebf72-ca1a-41e5-bc08-936ba09d7b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:20.458395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ebf72-ca1a-41e5-bc08-936ba09d7b7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:20.459318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ebf72-ca1a-41e5-bc08-936ba09d7b7f None admin] RBAC: Adding query filter params (interface=public, service_id=016784c2cd7e4b0b87ea81efcb88dff2, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:20.459821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ebf72-ca1a-41e5-bc08-936ba09d7b7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:20.461377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ebf72-ca1a-41e5-bc08-936ba09d7b7f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:20.467183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 447/910] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 31 11:22:20 2022] GET /identity/v3/endpoints?service_id=016784c2cd7e4b0b87ea81efcb88dff2&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:20.472588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ebf72-ca1a-41e5-bc08-936ba09d7b7f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:20.584104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ebf72-ca1a-41e5-bc08-936ba09d7b7f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:20.587997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a940c2-fab9-4d13-b012-56601f427774 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:20.623369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555cd43-1f50-47f2-9af3-2d8ab7715dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:20.624358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555cd43-1f50-47f2-9af3-2d8ab7715dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:20.624832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555cd43-1f50-47f2-9af3-2d8ab7715dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:20.625296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555cd43-1f50-47f2-9af3-2d8ab7715dd0 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:20.626088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555cd43-1f50-47f2-9af3-2d8ab7715dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:20.627702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555cd43-1f50-47f2-9af3-2d8ab7715dd0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:20.634079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 448/911] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 31 11:22:20 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:20.635829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fea8b-b29b-430e-bec8-f957012df997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:20.636512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fea8b-b29b-430e-bec8-f957012df997 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:20.636878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fea8b-b29b-430e-bec8-f957012df997 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:20.637220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fea8b-b29b-430e-bec8-f957012df997 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:20.637960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fea8b-b29b-430e-bec8-f957012df997 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:20.646001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fea8b-b29b-430e-bec8-f957012df997 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:20.660294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 464/912] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:22:20 2022] POST /identity/v3/services => generated 241 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:21.223488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e854-0c8a-419b-80a3-d62e72d0b537 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.224518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e854-0c8a-419b-80a3-d62e72d0b537 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.225015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e854-0c8a-419b-80a3-d62e72d0b537 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.226810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 449/913] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:21.231945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2c6d-8b6d-4325-a950-8d5babbfd458 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.232334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2c6d-8b6d-4325-a950-8d5babbfd458 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.232635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2c6d-8b6d-4325-a950-8d5babbfd458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.251406 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a82b2c6d-8b6d-4325-a950-8d5babbfd458 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:21.252601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a82b2c6d-8b6d-4325-a950-8d5babbfd458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:21.269146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:21.344051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 465/914] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:21.416522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46e2f-3c12-4339-aa8f-f0f068d9b26b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.416832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46e2f-3c12-4339-aa8f-f0f068d9b26b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.417076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46e2f-3c12-4339-aa8f-f0f068d9b26b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.418712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 450/915] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:21.424659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16967-1138-4235-b424-ab55f92de05e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.425137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16967-1138-4235-b424-ab55f92de05e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.425601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16967-1138-4235-b424-ab55f92de05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.445137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-85e16967-1138-4235-b424-ab55f92de05e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:21.446558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-85e16967-1138-4235-b424-ab55f92de05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:21.520452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 466/916] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:21.628577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a46e2f-3c12-4339-aa8f-f0f068d9b26b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:21.680362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:21.740899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a46e2f-3c12-4339-aa8f-f0f068d9b26b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:21.780783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c223f-f230-4fab-92df-37c3a61a5a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:21.780976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c223f-f230-4fab-92df-37c3a61a5a4d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.781274 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c223f-f230-4fab-92df-37c3a61a5a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.781552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c223f-f230-4fab-92df-37c3a61a5a4d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.782146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c223f-f230-4fab-92df-37c3a61a5a4d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:21.783722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c223f-f230-4fab-92df-37c3a61a5a4d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e35c223f-f230-4fab-92df-37c3a61a5a4d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:21.793988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:21.796420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 11:22:21.797299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:21.801101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 451/917] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:22:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:21.802376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16967-1138-4235-b424-ab55f92de05e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:21.830268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c223f-f230-4fab-92df-37c3a61a5a4d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:21.886033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:21.912180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16967-1138-4235-b424-ab55f92de05e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:21.938329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c223f-f230-4fab-92df-37c3a61a5a4d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:21.948074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:21.948895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f577060-49b8-4185-8336-9bf8ede3ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:21.949539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f577060-49b8-4185-8336-9bf8ede3ee9e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.950031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f577060-49b8-4185-8336-9bf8ede3ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.950409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f577060-49b8-4185-8336-9bf8ede3ee9e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.951594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f577060-49b8-4185-8336-9bf8ede3ee9e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:21.952113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f577060-49b8-4185-8336-9bf8ede3ee9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:21.953663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f577060-49b8-4185-8336-9bf8ede3ee9e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:21.963177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 467/918] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:22:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:21.967627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f577060-49b8-4185-8336-9bf8ede3ee9e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:21.984152 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15429d19-a355-444f-963e-d4e424095359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:21.984779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15429d19-a355-444f-963e-d4e424095359 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.985056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15429d19-a355-444f-963e-d4e424095359 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.985325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15429d19-a355-444f-963e-d4e424095359 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.995911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15429d19-a355-444f-963e-d4e424095359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-15429d19-a355-444f-963e-d4e424095359 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:22.002269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:22.003261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:22.004577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:22.006869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 452/919] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 31 11:22:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:22.010476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15429d19-a355-444f-963e-d4e424095359 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.115023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f577060-49b8-4185-8336-9bf8ede3ee9e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.153199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74b3fc-d144-4611-964f-7296f6682062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.153914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74b3fc-d144-4611-964f-7296f6682062 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.154257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74b3fc-d144-4611-964f-7296f6682062 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.155514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74b3fc-d144-4611-964f-7296f6682062 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.156007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15429d19-a355-444f-963e-d4e424095359 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.156353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74b3fc-d144-4611-964f-7296f6682062 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:22.156724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74b3fc-d144-4611-964f-7296f6682062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.158266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74b3fc-d144-4611-964f-7296f6682062 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.168609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 468/920] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 31 11:22:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:22.171294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74b3fc-d144-4611-964f-7296f6682062 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.176937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:22.203723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71d87d-fe01-499f-b085-1112c0695184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.204459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71d87d-fe01-499f-b085-1112c0695184 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.205004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71d87d-fe01-499f-b085-1112c0695184 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.205617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71d87d-fe01-499f-b085-1112c0695184 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.206544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71d87d-fe01-499f-b085-1112c0695184 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:22.207092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71d87d-fe01-499f-b085-1112c0695184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.209006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71d87d-fe01-499f-b085-1112c0695184 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.224580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 453/921] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 31 11:22:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:22.225703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71d87d-fe01-499f-b085-1112c0695184 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.272631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:22.324388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74b3fc-d144-4611-964f-7296f6682062 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.375556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfc9eb-426c-49df-8ca6-3109f9654bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.376418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc9eb-426c-49df-8ca6-3109f9654bbe None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.376869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc9eb-426c-49df-8ca6-3109f9654bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.377137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71d87d-fe01-499f-b085-1112c0695184 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.377452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfc9eb-426c-49df-8ca6-3109f9654bbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.378671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfc9eb-426c-49df-8ca6-3109f9654bbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.381540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfc9eb-426c-49df-8ca6-3109f9654bbe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.418980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 469/922] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:22.434629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a7459-3662-4065-bd45-493e20a4db7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.435312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a7459-3662-4065-bd45-493e20a4db7f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.435627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a7459-3662-4065-bd45-493e20a4db7f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.435904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a7459-3662-4065-bd45-493e20a4db7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.453829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a7459-3662-4065-bd45-493e20a4db7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.455534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a7459-3662-4065-bd45-493e20a4db7f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-de4a7459-3662-4065-bd45-493e20a4db7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:22.475489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:22.477827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:22.479772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:22.479772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:22.479772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:22.479772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 454/923] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:22.483781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfc9eb-426c-49df-8ca6-3109f9654bbe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.570017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:22.634063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfc9eb-426c-49df-8ca6-3109f9654bbe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.666547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddec4c-76ca-438a-84a8-cb33b2f60c83 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.666896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddec4c-76ca-438a-84a8-cb33b2f60c83 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.667144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddec4c-76ca-438a-84a8-cb33b2f60c83 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.668634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 455/924] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:22.676263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa292d2a-5563-4c21-90d4-d1ab455ccc00 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.677434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c82ff-51b3-4d82-aa42-b64c7674a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.677785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa292d2a-5563-4c21-90d4-d1ab455ccc00 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.678338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa292d2a-5563-4c21-90d4-d1ab455ccc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.678455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c82ff-51b3-4d82-aa42-b64c7674a78a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.678933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c82ff-51b3-4d82-aa42-b64c7674a78a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.679418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c82ff-51b3-4d82-aa42-b64c7674a78a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.680595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c82ff-51b3-4d82-aa42-b64c7674a78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:22.681143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c82ff-51b3-4d82-aa42-b64c7674a78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.683366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c82ff-51b3-4d82-aa42-b64c7674a78a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.702966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 470/925] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:22.704799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bdd62-dabb-422e-ac77-667c6b4f012f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.705286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bdd62-dabb-422e-ac77-667c6b4f012f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.705759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bdd62-dabb-422e-ac77-667c6b4f012f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.708167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 471/926] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:22.708555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-fa292d2a-5563-4c21-90d4-d1ab455ccc00 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:22.709216 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bdd62-dabb-422e-ac77-667c6b4f012f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.709751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fa292d2a-5563-4c21-90d4-d1ab455ccc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:22.795900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 456/927] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:22.797206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5549e7c-088d-488a-a0f6-b51edfbefc9f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.797495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5549e7c-088d-488a-a0f6-b51edfbefc9f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.797766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5549e7c-088d-488a-a0f6-b51edfbefc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.823273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d5549e7c-088d-488a-a0f6-b51edfbefc9f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:22.824413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d5549e7c-088d-488a-a0f6-b51edfbefc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:22.836582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:22.849027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bdd62-dabb-422e-ac77-667c6b4f012f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.875387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:22.895041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f507-ce4d-479a-a99d-ea873f1dcb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.896228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f507-ce4d-479a-a99d-ea873f1dcb5f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.896436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f507-ce4d-479a-a99d-ea873f1dcb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.896899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f507-ce4d-479a-a99d-ea873f1dcb5f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.906514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f507-ce4d-479a-a99d-ea873f1dcb5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.908741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f507-ce4d-479a-a99d-ea873f1dcb5f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.909336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 457/928] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8fc0f507-ce4d-479a-a99d-ea873f1dcb5f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:22.934803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:22.936409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:22.937485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:22.940199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 472/929] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:22:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:22.946378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5549e7c-088d-488a-a0f6-b51edfbefc9f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.069017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5549e7c-088d-488a-a0f6-b51edfbefc9f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.105181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d959a24-3f6b-4946-94aa-c9ae0c69caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.105804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d959a24-3f6b-4946-94aa-c9ae0c69caf6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.106148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d959a24-3f6b-4946-94aa-c9ae0c69caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.106425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d959a24-3f6b-4946-94aa-c9ae0c69caf6 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.107184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d959a24-3f6b-4946-94aa-c9ae0c69caf6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:23.107517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d959a24-3f6b-4946-94aa-c9ae0c69caf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.108932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d959a24-3f6b-4946-94aa-c9ae0c69caf6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.113894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f507-ce4d-479a-a99d-ea873f1dcb5f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.117457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:23.129377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 458/930] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 31 11:22:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:23.135636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d959a24-3f6b-4946-94aa-c9ae0c69caf6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.238787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f507-ce4d-479a-a99d-ea873f1dcb5f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.262068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d959a24-3f6b-4946-94aa-c9ae0c69caf6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.279349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae3e46-6eea-40b0-8eb2-eab2622e3660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.280196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae3e46-6eea-40b0-8eb2-eab2622e3660 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.280484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae3e46-6eea-40b0-8eb2-eab2622e3660 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.280757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae3e46-6eea-40b0-8eb2-eab2622e3660 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.281351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae3e46-6eea-40b0-8eb2-eab2622e3660 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.282760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae3e46-6eea-40b0-8eb2-eab2622e3660 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bfae3e46-6eea-40b0-8eb2-eab2622e3660 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:23.294099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:23.295751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:23.296628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 473/931] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:23.298056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae3e46-6eea-40b0-8eb2-eab2622e3660 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.306850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8e2f-535b-4578-b158-ed910594301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.307717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8e2f-535b-4578-b158-ed910594301e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.308160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8e2f-535b-4578-b158-ed910594301e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.308581 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8e2f-535b-4578-b158-ed910594301e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.319823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c8e2f-535b-4578-b158-ed910594301e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.321886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c8e2f-535b-4578-b158-ed910594301e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-0e2c8e2f-535b-4578-b158-ed910594301e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:23.338750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:23.339858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:23.341011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:23.341011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:23.341011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:23.344941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 459/932] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:23.345869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8e2f-535b-4578-b158-ed910594301e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.348192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:23.398960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:23.408371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae3e46-6eea-40b0-8eb2-eab2622e3660 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.444134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e8158-2aa4-4098-b720-69c1e720ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.444767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8158-2aa4-4098-b720-69c1e720ef72 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.445055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8158-2aa4-4098-b720-69c1e720ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.445329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8158-2aa4-4098-b720-69c1e720ef72 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.445914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e8158-2aa4-4098-b720-69c1e720ef72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.447325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e8158-2aa4-4098-b720-69c1e720ef72 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.453790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8e2f-535b-4578-b158-ed910594301e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9e6e8158-2aa4-4098-b720-69c1e720ef72 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:23.456428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:23.457416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:23.458332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 474/933] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:23.459549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e8158-2aa4-4098-b720-69c1e720ef72 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.493786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c9c1e-a98a-46f1-b2a3-5123dabd178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.494314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c9c1e-a98a-46f1-b2a3-5123dabd178a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.494593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c9c1e-a98a-46f1-b2a3-5123dabd178a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.494896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c9c1e-a98a-46f1-b2a3-5123dabd178a None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.495522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c9c1e-a98a-46f1-b2a3-5123dabd178a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:23.495821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c9c1e-a98a-46f1-b2a3-5123dabd178a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.497178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c9c1e-a98a-46f1-b2a3-5123dabd178a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.503221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 460/934] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:23.503995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c9c1e-a98a-46f1-b2a3-5123dabd178a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.576978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e8158-2aa4-4098-b720-69c1e720ef72 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.586146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:23.613386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367219bc-f9f7-45b4-86e5-c96b4fea8e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.613995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367219bc-f9f7-45b4-86e5-c96b4fea8e15 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.614342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367219bc-f9f7-45b4-86e5-c96b4fea8e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.614441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c9c1e-a98a-46f1-b2a3-5123dabd178a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.614617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367219bc-f9f7-45b4-86e5-c96b4fea8e15 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.615298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367219bc-f9f7-45b4-86e5-c96b4fea8e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:23.615594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367219bc-f9f7-45b4-86e5-c96b4fea8e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.616988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367219bc-f9f7-45b4-86e5-c96b4fea8e15 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.629625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 475/935] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:23.629780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:23.634985 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367219bc-f9f7-45b4-86e5-c96b4fea8e15 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.656221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89f0a4-99f2-45e5-99c6-e06cfeb0db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.656836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89f0a4-99f2-45e5-99c6-e06cfeb0db6b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.657114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89f0a4-99f2-45e5-99c6-e06cfeb0db6b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.657384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89f0a4-99f2-45e5-99c6-e06cfeb0db6b None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.658022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89f0a4-99f2-45e5-99c6-e06cfeb0db6b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:23.658320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89f0a4-99f2-45e5-99c6-e06cfeb0db6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.659730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89f0a4-99f2-45e5-99c6-e06cfeb0db6b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.664828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 461/936] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:23.670308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89f0a4-99f2-45e5-99c6-e06cfeb0db6b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.749677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367219bc-f9f7-45b4-86e5-c96b4fea8e15 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.786288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89f0a4-99f2-45e5-99c6-e06cfeb0db6b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.787829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5343-c7ca-48d2-8e64-26bcb006791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.788441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5343-c7ca-48d2-8e64-26bcb006791d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.789275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5343-c7ca-48d2-8e64-26bcb006791d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.789275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5343-c7ca-48d2-8e64-26bcb006791d None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.789611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d5343-c7ca-48d2-8e64-26bcb006791d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:23.789928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d5343-c7ca-48d2-8e64-26bcb006791d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.791338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d5343-c7ca-48d2-8e64-26bcb006791d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.801030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 476/937] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:23.801030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5343-c7ca-48d2-8e64-26bcb006791d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.828390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cebec-9f6f-47d9-aeae-232819b6a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.829021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cebec-9f6f-47d9-aeae-232819b6a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.829298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cebec-9f6f-47d9-aeae-232819b6a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.829568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cebec-9f6f-47d9-aeae-232819b6a5d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.836186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:23.836462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cebec-9f6f-47d9-aeae-232819b6a5d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.838411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cebec-9f6f-47d9-aeae-232819b6a5d0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-804cebec-9f6f-47d9-aeae-232819b6a5d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:23.850351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:23.851288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:23.852174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:23.852174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:23.852174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:23.852174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:23.852174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:23.852174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:23.852174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:23.852174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:23.852174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 462/938] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:23.852669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cebec-9f6f-47d9-aeae-232819b6a5d0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.890990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:23.914292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5343-c7ca-48d2-8e64-26bcb006791d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.949841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1125a37-82e5-46c2-8026-1d71a7bc428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.950443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1125a37-82e5-46c2-8026-1d71a7bc428f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.950745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1125a37-82e5-46c2-8026-1d71a7bc428f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.951017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1125a37-82e5-46c2-8026-1d71a7bc428f None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.951800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1125a37-82e5-46c2-8026-1d71a7bc428f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:23.952106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1125a37-82e5-46c2-8026-1d71a7bc428f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.953479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1125a37-82e5-46c2-8026-1d71a7bc428f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.958656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 477/939] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:23.959559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1125a37-82e5-46c2-8026-1d71a7bc428f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.965302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cebec-9f6f-47d9-aeae-232819b6a5d0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.002534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efc5e3-f4cf-4ced-bc1b-489f716620a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.003594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efc5e3-f4cf-4ced-bc1b-489f716620a3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.003876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efc5e3-f4cf-4ced-bc1b-489f716620a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.004150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efc5e3-f4cf-4ced-bc1b-489f716620a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.004877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efc5e3-f4cf-4ced-bc1b-489f716620a3 None admin] RBAC: Adding query filter params (interface=public, service_id=718bde90a69e463d9e41dc18bb7d24ff, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:24.005172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efc5e3-f4cf-4ced-bc1b-489f716620a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.006616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efc5e3-f4cf-4ced-bc1b-489f716620a3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.017028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 463/940] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/endpoints?service_id=718bde90a69e463d9e41dc18bb7d24ff&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:24.017028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efc5e3-f4cf-4ced-bc1b-489f716620a3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.060203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:24.067665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1125a37-82e5-46c2-8026-1d71a7bc428f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.114333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775f19d-5b48-41d1-9552-db61f73a56fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.114977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775f19d-5b48-41d1-9552-db61f73a56fe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.115255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775f19d-5b48-41d1-9552-db61f73a56fe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.115526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775f19d-5b48-41d1-9552-db61f73a56fe None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.116210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775f19d-5b48-41d1-9552-db61f73a56fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:24.116516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775f19d-5b48-41d1-9552-db61f73a56fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.117960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775f19d-5b48-41d1-9552-db61f73a56fe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.126699 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:24.130904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efc5e3-f4cf-4ced-bc1b-489f716620a3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.131507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 478/941] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:24.132476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775f19d-5b48-41d1-9552-db61f73a56fe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.172096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7b68-a329-4066-a2b9-bc1ba7a8f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.172705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7b68-a329-4066-a2b9-bc1ba7a8f5ab None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.172983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7b68-a329-4066-a2b9-bc1ba7a8f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.173255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7b68-a329-4066-a2b9-bc1ba7a8f5ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.173916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b7b68-a329-4066-a2b9-bc1ba7a8f5ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.175301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b7b68-a329-4066-a2b9-bc1ba7a8f5ab None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.201602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 464/942] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:24.202380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7b68-a329-4066-a2b9-bc1ba7a8f5ab None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.250021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775f19d-5b48-41d1-9552-db61f73a56fe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.297381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eab5a-5ba5-4be2-a380-db779096583c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.297919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eab5a-5ba5-4be2-a380-db779096583c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.298202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eab5a-5ba5-4be2-a380-db779096583c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.298478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eab5a-5ba5-4be2-a380-db779096583c None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.299154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eab5a-5ba5-4be2-a380-db779096583c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.300588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eab5a-5ba5-4be2-a380-db779096583c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.314720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 479/943] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 31 11:22:24 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:24.343687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7b68-a329-4066-a2b9-bc1ba7a8f5ab None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.389816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381eb2c-9e47-4844-849c-31ee2491aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.390579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381eb2c-9e47-4844-849c-31ee2491aaa2 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.390949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381eb2c-9e47-4844-849c-31ee2491aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.391294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381eb2c-9e47-4844-849c-31ee2491aaa2 None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/660b505867744099a74f3ade6bad2d86/roles/ca0823b45e484a0ca722ad52ab8804cf` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.393770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381eb2c-9e47-4844-849c-31ee2491aaa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=660b505867744099a74f3ade6bad2d86, role_id=ca0823b45e484a0ca722ad52ab8804cf)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.395469 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381eb2c-9e47-4844-849c-31ee2491aaa2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.411498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 465/944] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:22:24 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/660b505867744099a74f3ade6bad2d86/roles/ca0823b45e484a0ca722ad52ab8804cf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:24.507002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324edb-6ed3-4352-95c4-5dc261e35e1b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.507541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324edb-6ed3-4352-95c4-5dc261e35e1b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.507541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324edb-6ed3-4352-95c4-5dc261e35e1b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.509199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 480/945] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:24.515700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c085e-f01f-40f8-ac5f-b6ca8821870e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.516036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c085e-f01f-40f8-ac5f-b6ca8821870e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.516264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c085e-f01f-40f8-ac5f-b6ca8821870e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.536169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b15c085e-f01f-40f8-ac5f-b6ca8821870e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:24.537402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b15c085e-f01f-40f8-ac5f-b6ca8821870e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:24.550284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:24.617425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 466/946] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:24.895724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42324edb-6ed3-4352-95c4-5dc261e35e1b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.915809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:25.007008 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42324edb-6ed3-4352-95c4-5dc261e35e1b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.042041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.042659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.042980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.043254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.043913 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.045472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.048166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WARNING keystone.server.flask.common [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 11:22:25.067737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 11:22:25.067737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 11:22:25.067737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [parameters: {'id': 'f03febbf81ce465ba372362e3b996c90', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 11:22:25.067737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f03febbf81ce465ba372362e3b996c90.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f03febbf81ce465ba372362e3b996c90. Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 11:22:25.084418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 11:22:25.085285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Aug 31 11:22:25.086295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 11:22:25.087250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 11:22:25.088188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 11:22:25.088987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'id': 'f03febbf81ce465ba372362e3b996c90', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:25.089859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:25.090798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f03febbf81ce465ba372362e3b996c90. Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:25.092403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 481/947] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Aug 31 11:22:24 2022] POST /identity/v3/projects => generated 262 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:25.093577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c085e-f01f-40f8-ac5f-b6ca8821870e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:25.197850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c085e-f01f-40f8-ac5f-b6ca8821870e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.233836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c7667-5c9a-43cf-840b-e5b728374feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.234466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7667-5c9a-43cf-840b-e5b728374feb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.234777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7667-5c9a-43cf-840b-e5b728374feb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.235092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7667-5c9a-43cf-840b-e5b728374feb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.242080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7667-5c9a-43cf-840b-e5b728374feb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.243603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7667-5c9a-43cf-840b-e5b728374feb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6f9c7667-5c9a-43cf-840b-e5b728374feb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:25.255745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:25.257488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:25.259427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:25.259427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:25.259427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:25.259427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:25.259427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:25.259427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:25.259427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:25.259427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:25.259427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 467/948] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:25.263308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:25.339525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:25.375872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968b90f-67cc-473b-802a-3d4721eb8ca9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.414376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c647c7-b6fd-4770-a1ff-5132d1c03784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.415042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c647c7-b6fd-4770-a1ff-5132d1c03784 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.415325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c647c7-b6fd-4770-a1ff-5132d1c03784 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.415593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c647c7-b6fd-4770-a1ff-5132d1c03784 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.416269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c647c7-b6fd-4770-a1ff-5132d1c03784 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:25.416571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c647c7-b6fd-4770-a1ff-5132d1c03784 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.418221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c647c7-b6fd-4770-a1ff-5132d1c03784 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.446043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 482/949] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:26.219714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308f775-3a94-4bfb-adc7-2f25b2847498 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.220275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308f775-3a94-4bfb-adc7-2f25b2847498 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.220275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308f775-3a94-4bfb-adc7-2f25b2847498 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.221949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 468/950] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:26.227431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc4968-cc03-4f06-b35c-2d35201fd4c0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.227841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc4968-cc03-4f06-b35c-2d35201fd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.228016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc4968-cc03-4f06-b35c-2d35201fd4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.247092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6cfc4968-cc03-4f06-b35c-2d35201fd4c0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:26.249145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6cfc4968-cc03-4f06-b35c-2d35201fd4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:26.320926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 483/951] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:26.351290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4818-2f50-4cc3-8703-a10783d36da7 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.351584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4818-2f50-4cc3-8703-a10783d36da7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.351827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4818-2f50-4cc3-8703-a10783d36da7 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.353415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 469/952] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:26.360619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893c80e-ff50-4a7b-87fb-d6749bb155a4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.360951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893c80e-ff50-4a7b-87fb-d6749bb155a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.361230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893c80e-ff50-4a7b-87fb-d6749bb155a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.380673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2893c80e-ff50-4a7b-87fb-d6749bb155a4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:26.381847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2893c80e-ff50-4a7b-87fb-d6749bb155a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:26.445921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:26.452315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179af423-8482-41ad-97a3-4f6d4e9266f7 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.452593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179af423-8482-41ad-97a3-4f6d4e9266f7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.452862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179af423-8482-41ad-97a3-4f6d4e9266f7 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.454433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 470/953] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:26.458419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 484/954] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:26.459812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6683df3-530a-4ac0-8503-ff4d9ee5b1b5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.460098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6683df3-530a-4ac0-8503-ff4d9ee5b1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.460373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6683df3-530a-4ac0-8503-ff4d9ee5b1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.474255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:26.481536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e6683df3-530a-4ac0-8503-ff4d9ee5b1b5 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:26.483313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e6683df3-530a-4ac0-8503-ff4d9ee5b1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:26.553454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 471/955] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:26.605734 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893c80e-ff50-4a7b-87fb-d6749bb155a4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:26.716630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893c80e-ff50-4a7b-87fb-d6749bb155a4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:26.738361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6683df3-530a-4ac0-8503-ff4d9ee5b1b5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:26.761589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820dd7-af84-49a0-9431-3135142b4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:26.762232 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820dd7-af84-49a0-9431-3135142b4e41 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.762512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820dd7-af84-49a0-9431-3135142b4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.762854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820dd7-af84-49a0-9431-3135142b4e41 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.763450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba820dd7-af84-49a0-9431-3135142b4e41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:26.765550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba820dd7-af84-49a0-9431-3135142b4e41 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ba820dd7-af84-49a0-9431-3135142b4e41 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:26.778191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:26.779386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:26.780731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 485/956] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:26.785084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820dd7-af84-49a0-9431-3135142b4e41 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:26.844932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:26.865822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6683df3-530a-4ac0-8503-ff4d9ee5b1b5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:26.897417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820dd7-af84-49a0-9431-3135142b4e41 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:26.901798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65678be4-ba80-4702-ad01-b43320991404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:26.902435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65678be4-ba80-4702-ad01-b43320991404 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.902740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65678be4-ba80-4702-ad01-b43320991404 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.903020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65678be4-ba80-4702-ad01-b43320991404 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.903607 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65678be4-ba80-4702-ad01-b43320991404 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:26.905210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65678be4-ba80-4702-ad01-b43320991404 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:26.908145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-65678be4-ba80-4702-ad01-b43320991404 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:26.915592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:26.916646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:26.917489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 472/957] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:26.919537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65678be4-ba80-4702-ad01-b43320991404 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:26.938029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf5c7a-e4ee-4ce7-98b8-1f51b2a030d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:26.938639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf5c7a-e4ee-4ce7-98b8-1f51b2a030d0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.938949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf5c7a-e4ee-4ce7-98b8-1f51b2a030d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.939225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf5c7a-e4ee-4ce7-98b8-1f51b2a030d0 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.939862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf5c7a-e4ee-4ce7-98b8-1f51b2a030d0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:26.940165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf5c7a-e4ee-4ce7-98b8-1f51b2a030d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:26.941551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf5c7a-e4ee-4ce7-98b8-1f51b2a030d0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:26.951023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 486/958] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:26.952691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf5c7a-e4ee-4ce7-98b8-1f51b2a030d0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:27.037967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65678be4-ba80-4702-ad01-b43320991404 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:27.057294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf5c7a-e4ee-4ce7-98b8-1f51b2a030d0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:27.075844 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d71f4-6c3f-4064-b97d-af3f33465dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:27.077025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d71f4-6c3f-4064-b97d-af3f33465dec None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.077300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d71f4-6c3f-4064-b97d-af3f33465dec None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.077571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d71f4-6c3f-4064-b97d-af3f33465dec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.080897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:27.089371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d71f4-6c3f-4064-b97d-af3f33465dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7c5d71f4-6c3f-4064-b97d-af3f33465dec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:27.096689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:27.097891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 473/959] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 31 11:22:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:27.098898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d71f4-6c3f-4064-b97d-af3f33465dec None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:27.100977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef225bf-6396-4e61-968a-5d6f2f596825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:27.101592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef225bf-6396-4e61-968a-5d6f2f596825 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.101873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef225bf-6396-4e61-968a-5d6f2f596825 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.102149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef225bf-6396-4e61-968a-5d6f2f596825 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.102820 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef225bf-6396-4e61-968a-5d6f2f596825 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:27.103127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef225bf-6396-4e61-968a-5d6f2f596825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:27.104518 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef225bf-6396-4e61-968a-5d6f2f596825 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:27.109529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 487/960] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:27.110401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef225bf-6396-4e61-968a-5d6f2f596825 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:27.166395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:27.214279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d71f4-6c3f-4064-b97d-af3f33465dec None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:27.216187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef225bf-6396-4e61-968a-5d6f2f596825 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:27.249804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2a10-5842-4aab-bed8-474209a124d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:27.250410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2a10-5842-4aab-bed8-474209a124d1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.250706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2a10-5842-4aab-bed8-474209a124d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.251052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2a10-5842-4aab-bed8-474209a124d1 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.251688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2a10-5842-4aab-bed8-474209a124d1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:27.252089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2a10-5842-4aab-bed8-474209a124d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:27.253655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2a10-5842-4aab-bed8-474209a124d1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:27.254826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b039c-4af2-418b-a0d7-7c1581b56aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:27.255428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b039c-4af2-418b-a0d7-7c1581b56aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.255715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b039c-4af2-418b-a0d7-7c1581b56aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.255989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b039c-4af2-418b-a0d7-7c1581b56aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.256654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b039c-4af2-418b-a0d7-7c1581b56aa9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:27.256958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b039c-4af2-418b-a0d7-7c1581b56aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:27.258323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b039c-4af2-418b-a0d7-7c1581b56aa9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:27.271374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 474/961] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:27.271374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2a10-5842-4aab-bed8-474209a124d1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:27.281479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 488/962] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 31 11:22:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:27.294958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b039c-4af2-418b-a0d7-7c1581b56aa9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:27.364741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:27.391253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2a10-5842-4aab-bed8-474209a124d1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:27.419774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:27.435489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528dfef-c0a6-42c0-a967-806f778741b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:27.436593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528dfef-c0a6-42c0-a967-806f778741b5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.437014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528dfef-c0a6-42c0-a967-806f778741b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.437289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528dfef-c0a6-42c0-a967-806f778741b5 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.437929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528dfef-c0a6-42c0-a967-806f778741b5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:27.438227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528dfef-c0a6-42c0-a967-806f778741b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:27.440516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b039c-4af2-418b-a0d7-7c1581b56aa9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:27.440634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528dfef-c0a6-42c0-a967-806f778741b5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:27.446420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 475/963] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:27.462871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528dfef-c0a6-42c0-a967-806f778741b5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:27.479432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3b630-bc96-421a-af56-731e1c43c4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:27.480268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b630-bc96-421a-af56-731e1c43c4ac None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.480652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b630-bc96-421a-af56-731e1c43c4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.481475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b630-bc96-421a-af56-731e1c43c4ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.496907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3b630-bc96-421a-af56-731e1c43c4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:27.499348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3b630-bc96-421a-af56-731e1c43c4ac None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2fd3b630-bc96-421a-af56-731e1c43c4ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:27.519043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:27.520075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:27.520963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:27.520963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:27.520963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:27.520963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 489/964] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:27.522531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ae5e1-a96e-472b-a7ef-c063ae018efd None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.522848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ae5e1-a96e-472b-a7ef-c063ae018efd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.523131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ae5e1-a96e-472b-a7ef-c063ae018efd None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.524381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 490/965] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:27.526163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ae5e1-a96e-472b-a7ef-c063ae018efd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:27.584443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528dfef-c0a6-42c0-a967-806f778741b5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:27.621865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f763ce-ea15-4473-9651-c19eea4bdec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:27.622471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f763ce-ea15-4473-9651-c19eea4bdec7 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.622789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f763ce-ea15-4473-9651-c19eea4bdec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.623787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f763ce-ea15-4473-9651-c19eea4bdec7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.624468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f763ce-ea15-4473-9651-c19eea4bdec7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:27.625834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f763ce-ea15-4473-9651-c19eea4bdec7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:27.635756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:27.642431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ae5e1-a96e-472b-a7ef-c063ae018efd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:27.654334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 476/966] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:27.654334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219ae91-165a-4757-accc-565648b19f49 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.654334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219ae91-165a-4757-accc-565648b19f49 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.654334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219ae91-165a-4757-accc-565648b19f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.668305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8219ae91-165a-4757-accc-565648b19f49 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:27.669719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8219ae91-165a-4757-accc-565648b19f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:27.701918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab425888-ffd9-42d5-addc-57ba963ec99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:27.702675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425888-ffd9-42d5-addc-57ba963ec99e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.703521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425888-ffd9-42d5-addc-57ba963ec99e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.703897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425888-ffd9-42d5-addc-57ba963ec99e None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.704901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab425888-ffd9-42d5-addc-57ba963ec99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:27.705280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab425888-ffd9-42d5-addc-57ba963ec99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:27.707638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab425888-ffd9-42d5-addc-57ba963ec99e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:27.723441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:27.727835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 491/967] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:27.734789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab425888-ffd9-42d5-addc-57ba963ec99e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:27.761344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 477/968] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:27.851742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab425888-ffd9-42d5-addc-57ba963ec99e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:27.887745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dcd03-7456-42e5-9b7a-f83764841351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:27.888378 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dcd03-7456-42e5-9b7a-f83764841351 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:27.889196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dcd03-7456-42e5-9b7a-f83764841351 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:27.889474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dcd03-7456-42e5-9b7a-f83764841351 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:27.896874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290dcd03-7456-42e5-9b7a-f83764841351 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:27.898332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290dcd03-7456-42e5-9b7a-f83764841351 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-290dcd03-7456-42e5-9b7a-f83764841351 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:27.910644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:27.911812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 11:22:27.912970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:27.916503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 492/969] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:22:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:27.917855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219ae91-165a-4757-accc-565648b19f49 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:28.025407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219ae91-165a-4757-accc-565648b19f49 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:28.053089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dcd03-7456-42e5-9b7a-f83764841351 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:28.066488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dceb7-2288-4b88-bff5-2f83ade29a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:28.067378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dceb7-2288-4b88-bff5-2f83ade29a69 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:28.067799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dceb7-2288-4b88-bff5-2f83ade29a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:28.068206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dceb7-2288-4b88-bff5-2f83ade29a69 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:28.069114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dceb7-2288-4b88-bff5-2f83ade29a69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:28.069589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dceb7-2288-4b88-bff5-2f83ade29a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:28.070831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:28.071188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dceb7-2288-4b88-bff5-2f83ade29a69 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:28.096356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 478/970] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 31 11:22:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:28.098590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dceb7-2288-4b88-bff5-2f83ade29a69 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:28.139512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:28.191219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dcd03-7456-42e5-9b7a-f83764841351 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:28.232882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dceb7-2288-4b88-bff5-2f83ade29a69 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:28.236513 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:28.237301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:28.237722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:28.238167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:28.239006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:28.240606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:28.259191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 11:22:28.259191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 11:22:28.259191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [parameters: {'user_id': '3657a3f05ca64764a6c3dfb091975ed6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 11:22:28.259191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 31 11:22:28.271915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 11:22:28.273005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 11:22:28.274150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 11:22:28.275329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 11:22:28.277151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 11:22:28.278904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'user_id': '3657a3f05ca64764a6c3dfb091975ed6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:28.280677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 11:22:28.282328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 11:22:28.284889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 11:22:28.284889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 11:22:28.284889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 11:22:28.284889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 11:22:28.284889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 11:22:28.284889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:28.285303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fb7c9-1e77-42db-94db-a5e6708b07ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:28.285303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fb7c9-1e77-42db-94db-a5e6708b07ea None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:28.285303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fb7c9-1e77-42db-94db-a5e6708b07ea None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:28.285303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fb7c9-1e77-42db-94db-a5e6708b07ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:28.288047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 493/971] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 31 11:22:28 2022] POST /identity/v3/users => generated 160 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:28.293133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:28.359751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fb7c9-1e77-42db-94db-a5e6708b07ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:28.361540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fb7c9-1e77-42db-94db-a5e6708b07ea None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:28.380152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:28.395720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:28.410994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5af91-e11b-487b-89cf-843d1d5b97e4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:28.448312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf865fe2-e403-4db1-a8f7-4eb68e023d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:28.449045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865fe2-e403-4db1-a8f7-4eb68e023d46 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:28.449441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865fe2-e403-4db1-a8f7-4eb68e023d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:28.449787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865fe2-e403-4db1-a8f7-4eb68e023d46 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:28.458613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf865fe2-e403-4db1-a8f7-4eb68e023d46 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:28.460420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf865fe2-e403-4db1-a8f7-4eb68e023d46 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:28.472029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 479/972] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:22:28.478471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fb7c9-1e77-42db-94db-a5e6708b07ea None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cf865fe2-e403-4db1-a8f7-4eb68e023d46 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:28.478719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:28.479638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 11:22:28.480602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:28.483845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 494/973] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:22:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:28.489245 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf865fe2-e403-4db1-a8f7-4eb68e023d46 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:28.584186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fb7c9-1e77-42db-94db-a5e6708b07ea None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:28.597766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf865fe2-e403-4db1-a8f7-4eb68e023d46 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:28.615248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:28.621736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66c3ae-3d64-450f-b369-8468340c17e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:28.622556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c3ae-3d64-450f-b369-8468340c17e8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:28.623046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c3ae-3d64-450f-b369-8468340c17e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:28.623660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c3ae-3d64-450f-b369-8468340c17e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:28.634579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c3ae-3d64-450f-b369-8468340c17e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:28.636342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c3ae-3d64-450f-b369-8468340c17e8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:28.640379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed1cb6-b9c7-4888-8302-e189b3d33d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:28.641104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed1cb6-b9c7-4888-8302-e189b3d33d98 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:28.641562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed1cb6-b9c7-4888-8302-e189b3d33d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:28.641924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed1cb6-b9c7-4888-8302-e189b3d33d98 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:28.642799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed1cb6-b9c7-4888-8302-e189b3d33d98 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:28.643197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed1cb6-b9c7-4888-8302-e189b3d33d98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:28.644716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed1cb6-b9c7-4888-8302-e189b3d33d98 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-bb66c3ae-3d64-450f-b369-8468340c17e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:28.653637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:28.655360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:28.656276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:28.656276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:28.656276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:28.658055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 480/974] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:28.663832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:28.664685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66c3ae-3d64-450f-b369-8468340c17e8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:28.704370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 495/975] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 31 11:22:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:28.792089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66c3ae-3d64-450f-b369-8468340c17e8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:28.833524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2032-15d0-4d31-b6eb-8a9cb5bc2708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:28.834138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2032-15d0-4d31-b6eb-8a9cb5bc2708 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:28.834411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2032-15d0-4d31-b6eb-8a9cb5bc2708 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:28.834694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2032-15d0-4d31-b6eb-8a9cb5bc2708 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:28.835351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2032-15d0-4d31-b6eb-8a9cb5bc2708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:28.835647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2032-15d0-4d31-b6eb-8a9cb5bc2708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:28.837023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2032-15d0-4d31-b6eb-8a9cb5bc2708 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:28.851131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 481/976] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:28.856985 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed1cb6-b9c7-4888-8302-e189b3d33d98 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:28.966605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed1cb6-b9c7-4888-8302-e189b3d33d98 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:29.003319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1921-732f-4876-b14f-af6602dbdaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:29.004255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1921-732f-4876-b14f-af6602dbdaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:29.004255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1921-732f-4876-b14f-af6602dbdaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:29.004519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1921-732f-4876-b14f-af6602dbdaa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:29.012295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1921-732f-4876-b14f-af6602dbdaa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:29.014368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1921-732f-4876-b14f-af6602dbdaa6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4c7b1921-732f-4876-b14f-af6602dbdaa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:29.026493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:29.027565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:29.029048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:29.029048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:29.029048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:29.029048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:29.029048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:29.029048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:29.029048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:29.029048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:29.029048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 496/977] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:29.035996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2032-15d0-4d31-b6eb-8a9cb5bc2708 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:29.085841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:29.153163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2032-15d0-4d31-b6eb-8a9cb5bc2708 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:29.188842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d9781-ff5c-4b12-83f6-317101751516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:29.189439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d9781-ff5c-4b12-83f6-317101751516 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:29.189712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d9781-ff5c-4b12-83f6-317101751516 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:29.189978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d9781-ff5c-4b12-83f6-317101751516 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:29.190661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d9781-ff5c-4b12-83f6-317101751516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:29.190986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d9781-ff5c-4b12-83f6-317101751516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:29.192454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d9781-ff5c-4b12-83f6-317101751516 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:29.204760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 482/978] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:29.210800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1921-732f-4876-b14f-af6602dbdaa6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:29.245402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459510d-b723-41bf-bb98-a566d1ea11a0 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:29.245723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459510d-b723-41bf-bb98-a566d1ea11a0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:29.245965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459510d-b723-41bf-bb98-a566d1ea11a0 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:29.247563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 483/979] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:29.252855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c070ff-1ba7-42f3-91fb-fb1e86a8fd5b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:29.253138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c070ff-1ba7-42f3-91fb-fb1e86a8fd5b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:29.253413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c070ff-1ba7-42f3-91fb-fb1e86a8fd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:29.271413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-88c070ff-1ba7-42f3-91fb-fb1e86a8fd5b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:29.272596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-88c070ff-1ba7-42f3-91fb-fb1e86a8fd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:29.276145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:29.328368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1921-732f-4876-b14f-af6602dbdaa6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:29.348981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 484/980] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:29.363999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9e86a-af5e-4ba7-9e96-3dec3a5ea021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:29.364597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9e86a-af5e-4ba7-9e96-3dec3a5ea021 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:29.364873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9e86a-af5e-4ba7-9e96-3dec3a5ea021 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:29.365140 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9e86a-af5e-4ba7-9e96-3dec3a5ea021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:29.365921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9e86a-af5e-4ba7-9e96-3dec3a5ea021 None admin] RBAC: Adding query filter params (role.id=ca0823b45e484a0ca722ad52ab8804cf, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=660b505867744099a74f3ade6bad2d86) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:29.366226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9e86a-af5e-4ba7-9e96-3dec3a5ea021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:29.367678 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9e86a-af5e-4ba7-9e96-3dec3a5ea021 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:29.374332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 497/981] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:29 2022] GET /identity/v3/role_assignments?user.id=660b505867744099a74f3ade6bad2d86&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=ca0823b45e484a0ca722ad52ab8804cf => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:29.616965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c070ff-1ba7-42f3-91fb-fb1e86a8fd5b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:29.652696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:29.671672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20b37-4f74-4e35-b2b1-67f0161da043 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:29.671999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20b37-4f74-4e35-b2b1-67f0161da043 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:29.672344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20b37-4f74-4e35-b2b1-67f0161da043 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:29.673870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 498/982] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:29.678744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996006c-63a5-4e9a-a5d8-056f99718b18 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:29.679034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996006c-63a5-4e9a-a5d8-056f99718b18 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:29.679308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996006c-63a5-4e9a-a5d8-056f99718b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:29.699966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d996006c-63a5-4e9a-a5d8-056f99718b18 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:29.702100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d996006c-63a5-4e9a-a5d8-056f99718b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:29.733485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c070ff-1ba7-42f3-91fb-fb1e86a8fd5b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:29.772231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899de54-1fbd-4c69-af4e-069f629ceaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:29.772840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899de54-1fbd-4c69-af4e-069f629ceaeb None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:29.773118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899de54-1fbd-4c69-af4e-069f629ceaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:29.773554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899de54-1fbd-4c69-af4e-069f629ceaeb None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:29.774050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899de54-1fbd-4c69-af4e-069f629ceaeb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:29.775443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899de54-1fbd-4c69-af4e-069f629ceaeb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:29.778124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 499/983] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:29.794724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 485/984] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:22:29 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:30.048378 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996006c-63a5-4e9a-a5d8-056f99718b18 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:30.098968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:30.151845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996006c-63a5-4e9a-a5d8-056f99718b18 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:30.193419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb647c-574a-4c0a-b120-cc0074ded85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:30.194055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb647c-574a-4c0a-b120-cc0074ded85a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:30.194337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb647c-574a-4c0a-b120-cc0074ded85a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:30.194610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb647c-574a-4c0a-b120-cc0074ded85a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:30.195236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb647c-574a-4c0a-b120-cc0074ded85a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:30.196611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb647c-574a-4c0a-b120-cc0074ded85a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f2fb647c-574a-4c0a-b120-cc0074ded85a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:30.205484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:30.206459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:30.207640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:30.208816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 500/985] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:30.212657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899de54-1fbd-4c69-af4e-069f629ceaeb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:30.308516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:30.318441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899de54-1fbd-4c69-af4e-069f629ceaeb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:30.352906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec5d50-afff-4613-bd0a-e176ee25695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:30.353633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec5d50-afff-4613-bd0a-e176ee25695a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:30.353945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec5d50-afff-4613-bd0a-e176ee25695a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:30.354288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec5d50-afff-4613-bd0a-e176ee25695a None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:30.355026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec5d50-afff-4613-bd0a-e176ee25695a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:30.355394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec5d50-afff-4613-bd0a-e176ee25695a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:30.356835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec5d50-afff-4613-bd0a-e176ee25695a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:30.362889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 486/986] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:30.368443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb647c-574a-4c0a-b120-cc0074ded85a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:30.476558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb647c-574a-4c0a-b120-cc0074ded85a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:30.487832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:30.513649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e13895-47de-490d-9916-11d3c1a53512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:30.514413 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13895-47de-490d-9916-11d3c1a53512 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:30.514828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13895-47de-490d-9916-11d3c1a53512 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:30.515199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13895-47de-490d-9916-11d3c1a53512 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:30.515983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e13895-47de-490d-9916-11d3c1a53512 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:30.516382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e13895-47de-490d-9916-11d3c1a53512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:30.517842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e13895-47de-490d-9916-11d3c1a53512 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:30.522932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 501/987] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:30.528804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec5d50-afff-4613-bd0a-e176ee25695a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:30.631624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec5d50-afff-4613-bd0a-e176ee25695a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:30.665553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e456b7c-0bce-4e36-a9a2-56fa22d34969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:30.669042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e456b7c-0bce-4e36-a9a2-56fa22d34969 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:30.669042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e456b7c-0bce-4e36-a9a2-56fa22d34969 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:30.669042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e456b7c-0bce-4e36-a9a2-56fa22d34969 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:30.669042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e456b7c-0bce-4e36-a9a2-56fa22d34969 None admin] RBAC: Adding query filter params (interface=admin, service_id=718bde90a69e463d9e41dc18bb7d24ff, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:30.669042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e456b7c-0bce-4e36-a9a2-56fa22d34969 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:30.669417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e456b7c-0bce-4e36-a9a2-56fa22d34969 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:30.678720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 487/988] 10.222.0.64 () {56 vars in 1249 bytes} [Wed Aug 31 11:22:30 2022] GET /identity/v3/endpoints?service_id=718bde90a69e463d9e41dc18bb7d24ff&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:30.681289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e13895-47de-490d-9916-11d3c1a53512 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:30.797162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e13895-47de-490d-9916-11d3c1a53512 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:30.833147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e04aea-cb0a-4fe2-b52b-477ac809a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:30.833767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e04aea-cb0a-4fe2-b52b-477ac809a695 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:30.834051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e04aea-cb0a-4fe2-b52b-477ac809a695 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:30.834327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e04aea-cb0a-4fe2-b52b-477ac809a695 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:30.834959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e04aea-cb0a-4fe2-b52b-477ac809a695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:30.836338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e04aea-cb0a-4fe2-b52b-477ac809a695 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:30.850710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 502/989] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 31 11:22:30 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:31.324754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a58f-a6b6-442f-956e-961afe19bb87 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:31.325147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a58f-a6b6-442f-956e-961afe19bb87 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:31.325362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a58f-a6b6-442f-956e-961afe19bb87 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:31.327701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 488/990] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:31.332694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403399d0-1b0f-4966-a687-1e9ad9317ccb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:31.332992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403399d0-1b0f-4966-a687-1e9ad9317ccb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:31.333273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403399d0-1b0f-4966-a687-1e9ad9317ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:31.351979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-403399d0-1b0f-4966-a687-1e9ad9317ccb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:31.353162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-403399d0-1b0f-4966-a687-1e9ad9317ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:31.384029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:31.427823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 503/991] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:31.696803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a58f-a6b6-442f-956e-961afe19bb87 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:31.723450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:31.755411 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8614-698c-43d5-9b0a-8ee6ef2d3c1f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:31.755754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8614-698c-43d5-9b0a-8ee6ef2d3c1f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:31.755964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8614-698c-43d5-9b0a-8ee6ef2d3c1f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:31.757307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 504/992] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:31.762053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a90e-5f1b-4a64-9d38-0fb69c2005c7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:31.762340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a90e-5f1b-4a64-9d38-0fb69c2005c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:31.762617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a90e-5f1b-4a64-9d38-0fb69c2005c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:31.782749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bd51a90e-5f1b-4a64-9d38-0fb69c2005c7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:31.783933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bd51a90e-5f1b-4a64-9d38-0fb69c2005c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:31.805075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a58f-a6b6-442f-956e-961afe19bb87 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:31.840875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c390fc-0ab2-47a3-896a-f60f7698ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:31.841501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c390fc-0ab2-47a3-896a-f60f7698ab53 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:31.841805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c390fc-0ab2-47a3-896a-f60f7698ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:31.842181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c390fc-0ab2-47a3-896a-f60f7698ab53 None admin] PATH_INFO: `/v3/services/image` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:31.843020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c390fc-0ab2-47a3-896a-f60f7698ab53 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:31.844384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c390fc-0ab2-47a3-896a-f60f7698ab53 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-53c390fc-0ab2-47a3-896a-f60f7698ab53 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:31.853757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:31.854814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:31.855662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 489/993] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 31 11:22:31 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:31.860754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c390fc-0ab2-47a3-896a-f60f7698ab53 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:31.862368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 505/994] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:31.950442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:31.967589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c390fc-0ab2-47a3-896a-f60f7698ab53 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.002154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fae24a-c0aa-445b-a4de-00b12fc0a5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.002781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fae24a-c0aa-445b-a4de-00b12fc0a5eb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.003103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fae24a-c0aa-445b-a4de-00b12fc0a5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.003373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fae24a-c0aa-445b-a4de-00b12fc0a5eb None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.003951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fae24a-c0aa-445b-a4de-00b12fc0a5eb None admin] RBAC: Adding query filter params (name=image) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:32.004253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fae24a-c0aa-445b-a4de-00b12fc0a5eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.005613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fae24a-c0aa-445b-a4de-00b12fc0a5eb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.011050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 490/995] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:32.017126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a90e-5f1b-4a64-9d38-0fb69c2005c7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:32.114292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:32.120666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a90e-5f1b-4a64-9d38-0fb69c2005c7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.132107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fae24a-c0aa-445b-a4de-00b12fc0a5eb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:32.162934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611a50-754b-4bcd-9dab-6ebaf7d4c228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.163548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611a50-754b-4bcd-9dab-6ebaf7d4c228 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.163827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611a50-754b-4bcd-9dab-6ebaf7d4c228 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.164101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611a50-754b-4bcd-9dab-6ebaf7d4c228 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.164734 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611a50-754b-4bcd-9dab-6ebaf7d4c228 None admin] RBAC: Adding query filter params (type=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:32.165037 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611a50-754b-4bcd-9dab-6ebaf7d4c228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.166405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611a50-754b-4bcd-9dab-6ebaf7d4c228 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.171739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 506/996] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:32.244541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fae24a-c0aa-445b-a4de-00b12fc0a5eb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.282930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84f575-1946-4445-a400-57415fb99d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.283577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84f575-1946-4445-a400-57415fb99d11 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.283852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84f575-1946-4445-a400-57415fb99d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.284120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84f575-1946-4445-a400-57415fb99d11 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.284703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84f575-1946-4445-a400-57415fb99d11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.286072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84f575-1946-4445-a400-57415fb99d11 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ed84f575-1946-4445-a400-57415fb99d11 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:32.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:32.297551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:32.298422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 491/997] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:32.303721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611a50-754b-4bcd-9dab-6ebaf7d4c228 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:32.410076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611a50-754b-4bcd-9dab-6ebaf7d4c228 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.445439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356714c-dc0e-4856-be34-80e5adb3228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.446047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356714c-dc0e-4856-be34-80e5adb3228d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.446327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356714c-dc0e-4856-be34-80e5adb3228d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.446600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356714c-dc0e-4856-be34-80e5adb3228d None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.447271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356714c-dc0e-4856-be34-80e5adb3228d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:32.447578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356714c-dc0e-4856-be34-80e5adb3228d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.448956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356714c-dc0e-4856-be34-80e5adb3228d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.458469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 507/998] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:32.459646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84f575-1946-4445-a400-57415fb99d11 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:32.476400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:32.563393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84f575-1946-4445-a400-57415fb99d11 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.596684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889a801-9c7a-4d3a-b987-87a76231bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.597293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889a801-9c7a-4d3a-b987-87a76231bc74 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.597833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889a801-9c7a-4d3a-b987-87a76231bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.598101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889a801-9c7a-4d3a-b987-87a76231bc74 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.598760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889a801-9c7a-4d3a-b987-87a76231bc74 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:32.599065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889a801-9c7a-4d3a-b987-87a76231bc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.600429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889a801-9c7a-4d3a-b987-87a76231bc74 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.605673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 492/999] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:32.611936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356714c-dc0e-4856-be34-80e5adb3228d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:32.638079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:32.720093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356714c-dc0e-4856-be34-80e5adb3228d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.753577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e398-5681-474b-96b6-c08f951b4078 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.754102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e398-5681-474b-96b6-c08f951b4078 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.754102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e398-5681-474b-96b6-c08f951b4078 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.755584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 493/1000] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:32.756460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032fbef-0c38-4a30-98a2-f6c22343bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.757064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032fbef-0c38-4a30-98a2-f6c22343bb8c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.757345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032fbef-0c38-4a30-98a2-f6c22343bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.757617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032fbef-0c38-4a30-98a2-f6c22343bb8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.758325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032fbef-0c38-4a30-98a2-f6c22343bb8c None admin] RBAC: Adding query filter params (interface=public, service_id=1682081716294beabd9ffa61665bcf40, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:32.758633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032fbef-0c38-4a30-98a2-f6c22343bb8c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.760035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032fbef-0c38-4a30-98a2-f6c22343bb8c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.760307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566ccd-5b22-42f8-8ccb-d1e7e64e54d6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.760585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566ccd-5b22-42f8-8ccb-d1e7e64e54d6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.760858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566ccd-5b22-42f8-8ccb-d1e7e64e54d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.768184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 508/1001] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 31 11:22:32 2022] GET /identity/v3/endpoints?service_id=1682081716294beabd9ffa61665bcf40&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:32.773351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032fbef-0c38-4a30-98a2-f6c22343bb8c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:32.780104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-87566ccd-5b22-42f8-8ccb-d1e7e64e54d6 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:32.781425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-87566ccd-5b22-42f8-8ccb-d1e7e64e54d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:32.853916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 494/1002] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:32.868451 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:32.883784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032fbef-0c38-4a30-98a2-f6c22343bb8c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.918457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72944574-61a2-4d85-93af-b3dced5ad242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.919092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72944574-61a2-4d85-93af-b3dced5ad242 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.919372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72944574-61a2-4d85-93af-b3dced5ad242 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.919645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72944574-61a2-4d85-93af-b3dced5ad242 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.920286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72944574-61a2-4d85-93af-b3dced5ad242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.921770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72944574-61a2-4d85-93af-b3dced5ad242 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.928223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 509/1003] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 31 11:22:32 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:33.128522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87566ccd-5b22-42f8-8ccb-d1e7e64e54d6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:33.138978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:33.230318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87566ccd-5b22-42f8-8ccb-d1e7e64e54d6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:33.267413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb4bea-d482-45b5-81cc-aad31db1e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:33.268049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb4bea-d482-45b5-81cc-aad31db1e63c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:33.268328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb4bea-d482-45b5-81cc-aad31db1e63c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:33.268601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb4bea-d482-45b5-81cc-aad31db1e63c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:33.269185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb4bea-d482-45b5-81cc-aad31db1e63c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:33.270556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb4bea-d482-45b5-81cc-aad31db1e63c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c1eb4bea-d482-45b5-81cc-aad31db1e63c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:33.279910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:33.281001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:22:33.281878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:33.283276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 495/1004] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 31 11:22:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:33.287253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72944574-61a2-4d85-93af-b3dced5ad242 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:33.388219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72944574-61a2-4d85-93af-b3dced5ad242 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:33.421394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74719d53-97e7-4bb2-865f-f979e15c908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:33.422014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74719d53-97e7-4bb2-865f-f979e15c908e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:33.422271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74719d53-97e7-4bb2-865f-f979e15c908e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:33.422548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74719d53-97e7-4bb2-865f-f979e15c908e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:33.423218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74719d53-97e7-4bb2-865f-f979e15c908e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:33.423526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74719d53-97e7-4bb2-865f-f979e15c908e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:33.424908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74719d53-97e7-4bb2-865f-f979e15c908e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:33.429809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 510/1005] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:33.435291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb4bea-d482-45b5-81cc-aad31db1e63c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:33.505941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:33.538314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb4bea-d482-45b5-81cc-aad31db1e63c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:33.572141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed51eba-fb3a-4e24-a9ce-24026fe99f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:33.572747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51eba-fb3a-4e24-a9ce-24026fe99f7a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:33.573027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51eba-fb3a-4e24-a9ce-24026fe99f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:33.573298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51eba-fb3a-4e24-a9ce-24026fe99f7a None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:33.573928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51eba-fb3a-4e24-a9ce-24026fe99f7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:33.574230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51eba-fb3a-4e24-a9ce-24026fe99f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:33.575628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51eba-fb3a-4e24-a9ce-24026fe99f7a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:33.585445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 496/1006] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 31 11:22:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:33.586726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74719d53-97e7-4bb2-865f-f979e15c908e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:33.606870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:33.697234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74719d53-97e7-4bb2-865f-f979e15c908e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:33.732071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8f70a-bd73-441d-894a-e41e2c3c0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:33.732814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f70a-bd73-441d-894a-e41e2c3c0b07 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:33.733095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f70a-bd73-441d-894a-e41e2c3c0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:33.733369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f70a-bd73-441d-894a-e41e2c3c0b07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:33.734034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8f70a-bd73-441d-894a-e41e2c3c0b07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:33.735439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8f70a-bd73-441d-894a-e41e2c3c0b07 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:33.758703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 511/1007] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:34.080350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48964372-329d-41bc-9e5f-67c2183028c1 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:34.080874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48964372-329d-41bc-9e5f-67c2183028c1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:34.081149 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48964372-329d-41bc-9e5f-67c2183028c1 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:34.082386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 497/1008] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:34.087706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d631-39d2-48c5-919d-3fd9a276e323 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:34.087992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d631-39d2-48c5-919d-3fd9a276e323 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:34.088264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d631-39d2-48c5-919d-3fd9a276e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:34.106586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7ad3d631-39d2-48c5-919d-3fd9a276e323 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:34.107821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7ad3d631-39d2-48c5-919d-3fd9a276e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:34.181212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 512/1009] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:34.448512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48964372-329d-41bc-9e5f-67c2183028c1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:34.550175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48964372-329d-41bc-9e5f-67c2183028c1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:34.583373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0625a5-4415-4e42-b871-b65c46901608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:34.583967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0625a5-4415-4e42-b871-b65c46901608 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:34.584246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0625a5-4415-4e42-b871-b65c46901608 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:34.584512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0625a5-4415-4e42-b871-b65c46901608 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:34.585160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0625a5-4415-4e42-b871-b65c46901608 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:34.586503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0625a5-4415-4e42-b871-b65c46901608 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:34.590726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:34.609108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 498/1010] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:22:34 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:34.876456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3381bf3-b0f4-47de-ba3e-65ad036ac727 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:34.876991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3381bf3-b0f4-47de-ba3e-65ad036ac727 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:34.876991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3381bf3-b0f4-47de-ba3e-65ad036ac727 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:34.878516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 513/1011] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:34.883549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd483a-79db-4ae3-aa17-5aa7ae54b3ef None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:34.883840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd483a-79db-4ae3-aa17-5aa7ae54b3ef None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:34.884112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd483a-79db-4ae3-aa17-5aa7ae54b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:34.902732 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6acd483a-79db-4ae3-aa17-5aa7ae54b3ef None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:34.903912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6acd483a-79db-4ae3-aa17-5aa7ae54b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:34.978776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 499/1012] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:34 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:35.248970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3381bf3-b0f4-47de-ba3e-65ad036ac727 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:35.251918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:35.350834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3381bf3-b0f4-47de-ba3e-65ad036ac727 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:35.385356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24977eca-e264-44c7-ad83-0cf112b3a18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:35.385984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24977eca-e264-44c7-ad83-0cf112b3a18d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:35.386263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24977eca-e264-44c7-ad83-0cf112b3a18d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:35.386537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24977eca-e264-44c7-ad83-0cf112b3a18d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:35.387148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24977eca-e264-44c7-ad83-0cf112b3a18d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:35.388535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24977eca-e264-44c7-ad83-0cf112b3a18d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-24977eca-e264-44c7-ad83-0cf112b3a18d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:35.397410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:35.398548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:35.399735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 514/1013] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:35.404511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd483a-79db-4ae3-aa17-5aa7ae54b3ef None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:35.502439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd483a-79db-4ae3-aa17-5aa7ae54b3ef None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:35.525054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:35.537861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24686c3-6707-4cbc-837e-f3d117667197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:35.538468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24686c3-6707-4cbc-837e-f3d117667197 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:35.538774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24686c3-6707-4cbc-837e-f3d117667197 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:35.539048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24686c3-6707-4cbc-837e-f3d117667197 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:35.539675 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24686c3-6707-4cbc-837e-f3d117667197 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:35.539971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24686c3-6707-4cbc-837e-f3d117667197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:35.541343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24686c3-6707-4cbc-837e-f3d117667197 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:35.546780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 500/1014] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:35.552408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24977eca-e264-44c7-ad83-0cf112b3a18d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:35.623473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:35.660658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24977eca-e264-44c7-ad83-0cf112b3a18d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:35.664958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f0ea6-7b72-4373-a9ba-8c7f848d6426 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:35.665240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f0ea6-7b72-4373-a9ba-8c7f848d6426 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:35.665512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f0ea6-7b72-4373-a9ba-8c7f848d6426 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:35.667026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 501/1015] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:35.672822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a7c0-a322-4e07-8122-8b576f1cfcee None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:35.673099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a7c0-a322-4e07-8122-8b576f1cfcee None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:35.673366 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a7c0-a322-4e07-8122-8b576f1cfcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:35.691840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cc57a7c0-a322-4e07-8122-8b576f1cfcee None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:35.693144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cc57a7c0-a322-4e07-8122-8b576f1cfcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:35.707605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ef4b0-2a59-4749-b48a-d185a96cd75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:35.708480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef4b0-2a59-4749-b48a-d185a96cd75b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:35.708967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef4b0-2a59-4749-b48a-d185a96cd75b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:35.709239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef4b0-2a59-4749-b48a-d185a96cd75b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:35.709866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ef4b0-2a59-4749-b48a-d185a96cd75b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:35.710176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ef4b0-2a59-4749-b48a-d185a96cd75b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:35.711584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ef4b0-2a59-4749-b48a-d185a96cd75b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:35.716467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 515/1016] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 31 11:22:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:35.723460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ef4b0-2a59-4749-b48a-d185a96cd75b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:35.771261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 502/1017] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:35 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:35.829253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ef4b0-2a59-4749-b48a-d185a96cd75b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:35.858009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:35.864569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ee837-76b3-4385-9711-f8c0eff179e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:35.865168 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ee837-76b3-4385-9711-f8c0eff179e7 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:35.865445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ee837-76b3-4385-9711-f8c0eff179e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:35.865714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ee837-76b3-4385-9711-f8c0eff179e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:35.866364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ee837-76b3-4385-9711-f8c0eff179e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:35.867773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ee837-76b3-4385-9711-f8c0eff179e7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:35.887700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 516/1018] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:36.042556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57a7c0-a322-4e07-8122-8b576f1cfcee None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:36.149477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57a7c0-a322-4e07-8122-8b576f1cfcee None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:36.167193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:36.191738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfcdb3-7efb-42ec-9e51-51c003449a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:36.192363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfcdb3-7efb-42ec-9e51-51c003449a71 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.192637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfcdb3-7efb-42ec-9e51-51c003449a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.192902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfcdb3-7efb-42ec-9e51-51c003449a71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.194002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfcdb3-7efb-42ec-9e51-51c003449a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:36.195484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfcdb3-7efb-42ec-9e51-51c003449a71 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:36.197195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 503/1019] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:36.203610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ee837-76b3-4385-9711-f8c0eff179e7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:36.309173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ee837-76b3-4385-9711-f8c0eff179e7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:36.344685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d9633-220e-4f8d-b3aa-4a521e37eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:36.345305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d9633-220e-4f8d-b3aa-4a521e37eccd None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.345586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d9633-220e-4f8d-b3aa-4a521e37eccd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.345857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d9633-220e-4f8d-b3aa-4a521e37eccd None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.346511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d9633-220e-4f8d-b3aa-4a521e37eccd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:36.348269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d9633-220e-4f8d-b3aa-4a521e37eccd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:36.379933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 517/1020] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:22:36 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:36.574825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850c9f-2e0c-4ec8-b6df-1d43d0d759d1 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.575332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850c9f-2e0c-4ec8-b6df-1d43d0d759d1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.575332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850c9f-2e0c-4ec8-b6df-1d43d0d759d1 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.577481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 504/1021] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:36.582930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047d7fb-75ce-4fc1-acc4-d554a1f3ed16 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.583252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047d7fb-75ce-4fc1-acc4-d554a1f3ed16 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.583530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047d7fb-75ce-4fc1-acc4-d554a1f3ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.601953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3047d7fb-75ce-4fc1-acc4-d554a1f3ed16 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:36.603338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3047d7fb-75ce-4fc1-acc4-d554a1f3ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:36.635315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:36.681074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 518/1022] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:36.956344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850c9f-2e0c-4ec8-b6df-1d43d0d759d1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.062075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850c9f-2e0c-4ec8-b6df-1d43d0d759d1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.097933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059553bf-7ab4-47b2-b446-c9f5f111ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.098580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059553bf-7ab4-47b2-b446-c9f5f111ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.098888 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059553bf-7ab4-47b2-b446-c9f5f111ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.099159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059553bf-7ab4-47b2-b446-c9f5f111ecb8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.099753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059553bf-7ab4-47b2-b446-c9f5f111ecb8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.101144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059553bf-7ab4-47b2-b446-c9f5f111ecb8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-059553bf-7ab4-47b2-b446-c9f5f111ecb8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:37.111332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:37.112407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:22:37.113247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:37.117600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 505/1023] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 31 11:22:36 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:37.118975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047d7fb-75ce-4fc1-acc4-d554a1f3ed16 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.217630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047d7fb-75ce-4fc1-acc4-d554a1f3ed16 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.251305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681648d-23d3-43b2-957b-98061597a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.251916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681648d-23d3-43b2-957b-98061597a5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.252196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681648d-23d3-43b2-957b-98061597a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.252470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681648d-23d3-43b2-957b-98061597a5c7 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.253107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681648d-23d3-43b2-957b-98061597a5c7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:37.253409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681648d-23d3-43b2-957b-98061597a5c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.254831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681648d-23d3-43b2-957b-98061597a5c7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.259898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 519/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:37.265564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059553bf-7ab4-47b2-b446-c9f5f111ecb8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.311321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:37.366690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059553bf-7ab4-47b2-b446-c9f5f111ecb8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.401019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac3cbe-061c-4b2b-836f-55d39f6656b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.401621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac3cbe-061c-4b2b-836f-55d39f6656b6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.401900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac3cbe-061c-4b2b-836f-55d39f6656b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.402171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac3cbe-061c-4b2b-836f-55d39f6656b6 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.402835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac3cbe-061c-4b2b-836f-55d39f6656b6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:37.403135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac3cbe-061c-4b2b-836f-55d39f6656b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.405079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac3cbe-061c-4b2b-836f-55d39f6656b6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.414910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 506/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:37.416200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681648d-23d3-43b2-957b-98061597a5c7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.448260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:37.522389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681648d-23d3-43b2-957b-98061597a5c7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.556134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f3f2c-8aae-4222-bac7-507261df1f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.556737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f3f2c-8aae-4222-bac7-507261df1f0e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.557008 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f3f2c-8aae-4222-bac7-507261df1f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.557278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f3f2c-8aae-4222-bac7-507261df1f0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.557975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f3f2c-8aae-4222-bac7-507261df1f0e None admin] RBAC: Adding query filter params (interface=public, service_id=381a1d2520454bd1b07275992cedcba0, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:37.558279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f3f2c-8aae-4222-bac7-507261df1f0e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.559681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f3f2c-8aae-4222-bac7-507261df1f0e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.565075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 520/1026] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 31 11:22:37 2022] GET /identity/v3/endpoints?service_id=381a1d2520454bd1b07275992cedcba0&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:37.570386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac3cbe-061c-4b2b-836f-55d39f6656b6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.673645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac3cbe-061c-4b2b-836f-55d39f6656b6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.682556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:37.714327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83f643-20b9-42c0-aeb1-f319ce8dc4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.714966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83f643-20b9-42c0-aeb1-f319ce8dc4ab None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.715243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83f643-20b9-42c0-aeb1-f319ce8dc4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.715511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83f643-20b9-42c0-aeb1-f319ce8dc4ab None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.716106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83f643-20b9-42c0-aeb1-f319ce8dc4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.718027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83f643-20b9-42c0-aeb1-f319ce8dc4ab None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.730708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 507/1027] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 31 11:22:37 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:37.955702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b97858-8d18-4ed7-95f8-d66df908ea9f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.956052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b97858-8d18-4ed7-95f8-d66df908ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.956233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b97858-8d18-4ed7-95f8-d66df908ea9f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.957605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 521/1028] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:37.962776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74edd8-f624-4bab-835f-6e80782d8799 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.963062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74edd8-f624-4bab-835f-6e80782d8799 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.963334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74edd8-f624-4bab-835f-6e80782d8799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.981697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ea74edd8-f624-4bab-835f-6e80782d8799 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:37.983070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ea74edd8-f624-4bab-835f-6e80782d8799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:38.050733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 508/1029] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:38.324513 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b97858-8d18-4ed7-95f8-d66df908ea9f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.339251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c1f2-6787-4293-b0d0-8a3a4d5c5bbd None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.339665 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c1f2-6787-4293-b0d0-8a3a4d5c5bbd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.340010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c1f2-6787-4293-b0d0-8a3a4d5c5bbd None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.341605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 509/1030] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:38.347255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1f619-415c-409d-802e-854418ead6fe None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.347856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1f619-415c-409d-802e-854418ead6fe None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.348216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1f619-415c-409d-802e-854418ead6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.366174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b3f1f619-415c-409d-802e-854418ead6fe None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:38.367372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b3f1f619-415c-409d-802e-854418ead6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:38.427474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:38.435924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b97858-8d18-4ed7-95f8-d66df908ea9f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.442848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 510/1031] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:38.470730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c071dd-034a-4316-8259-13ffeebaf3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.471364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c071dd-034a-4316-8259-13ffeebaf3be None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.471643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c071dd-034a-4316-8259-13ffeebaf3be None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.471919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c071dd-034a-4316-8259-13ffeebaf3be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.482130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c071dd-034a-4316-8259-13ffeebaf3be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-82c071dd-034a-4316-8259-13ffeebaf3be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:38.487119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:38.488040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:38.488884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:38.491000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 522/1032] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 31 11:22:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:38.494011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1f619-415c-409d-802e-854418ead6fe None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.525075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:38.594216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1f619-415c-409d-802e-854418ead6fe None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.628081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97626c00-9670-4d0f-a98e-5526303fab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.628686 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97626c00-9670-4d0f-a98e-5526303fab9e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.628965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97626c00-9670-4d0f-a98e-5526303fab9e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.629234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97626c00-9670-4d0f-a98e-5526303fab9e None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.629889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97626c00-9670-4d0f-a98e-5526303fab9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:38.630185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97626c00-9670-4d0f-a98e-5526303fab9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.631568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97626c00-9670-4d0f-a98e-5526303fab9e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.640030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 511/1033] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 31 11:22:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:38.645855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c071dd-034a-4316-8259-13ffeebaf3be None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.708237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97626c00-9670-4d0f-a98e-5526303fab9e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.761248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c071dd-034a-4316-8259-13ffeebaf3be None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.799690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf9da2-550d-45be-b25f-d79e3cd07efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.800795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf9da2-550d-45be-b25f-d79e3cd07efc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.801261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf9da2-550d-45be-b25f-d79e3cd07efc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.801724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf9da2-550d-45be-b25f-d79e3cd07efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.811816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:38.818408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf9da2-550d-45be-b25f-d79e3cd07efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.819921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf9da2-550d-45be-b25f-d79e3cd07efc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.820168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97626c00-9670-4d0f-a98e-5526303fab9e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c1bf9da2-550d-45be-b25f-d79e3cd07efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:38.837091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:38.838085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:38.839631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:38.839631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:38.839631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:38.839631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 523/1034] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:38.844005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf9da2-550d-45be-b25f-d79e3cd07efc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.856136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:38.860262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621211d-7396-441b-b73f-e3449f2647a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.860917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621211d-7396-441b-b73f-e3449f2647a5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.861200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621211d-7396-441b-b73f-e3449f2647a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.861439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621211d-7396-441b-b73f-e3449f2647a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.862548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621211d-7396-441b-b73f-e3449f2647a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.864016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621211d-7396-441b-b73f-e3449f2647a5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.865583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 512/1035] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:38.871157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621211d-7396-441b-b73f-e3449f2647a5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.953632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf9da2-550d-45be-b25f-d79e3cd07efc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.976816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621211d-7396-441b-b73f-e3449f2647a5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.988699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba4db-e638-4370-9ac4-307635cd79d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.989594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba4db-e638-4370-9ac4-307635cd79d9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.990078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba4db-e638-4370-9ac4-307635cd79d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.990585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba4db-e638-4370-9ac4-307635cd79d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.991450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ba4db-e638-4370-9ac4-307635cd79d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:38.991949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ba4db-e638-4370-9ac4-307635cd79d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.993512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ba4db-e638-4370-9ac4-307635cd79d9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.007223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 524/1036] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:39.012811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba4db-e638-4370-9ac4-307635cd79d9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.016433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db00587-6dff-4271-98dc-e20773206c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.017045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db00587-6dff-4271-98dc-e20773206c08 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.017325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db00587-6dff-4271-98dc-e20773206c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.017595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db00587-6dff-4271-98dc-e20773206c08 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.018314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db00587-6dff-4271-98dc-e20773206c08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.019769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db00587-6dff-4271-98dc-e20773206c08 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.042732 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 513/1037] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:22:38 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:39.089055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:39.128645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba4db-e638-4370-9ac4-307635cd79d9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.164955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b75c9d-a842-4a53-8166-962d8930ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.165608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75c9d-a842-4a53-8166-962d8930ff43 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.165893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75c9d-a842-4a53-8166-962d8930ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.166170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75c9d-a842-4a53-8166-962d8930ff43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.175221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75c9d-a842-4a53-8166-962d8930ff43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.176699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75c9d-a842-4a53-8166-962d8930ff43 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a6b75c9d-a842-4a53-8166-962d8930ff43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:39.191191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:39.192196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:39.193170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 525/1038] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 31 11:22:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:39.198317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db00587-6dff-4271-98dc-e20773206c08 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.218995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:39.308266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db00587-6dff-4271-98dc-e20773206c08 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.342160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816ecb-b278-4a31-8c6f-61caf971ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.342941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816ecb-b278-4a31-8c6f-61caf971ec5c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.343041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816ecb-b278-4a31-8c6f-61caf971ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.343304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816ecb-b278-4a31-8c6f-61caf971ec5c None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.344031 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816ecb-b278-4a31-8c6f-61caf971ec5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:39.344331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816ecb-b278-4a31-8c6f-61caf971ec5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.345744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816ecb-b278-4a31-8c6f-61caf971ec5c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.363958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 514/1039] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 31 11:22:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:39.369812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b75c9d-a842-4a53-8166-962d8930ff43 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.473455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b75c9d-a842-4a53-8166-962d8930ff43 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.499791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:39.509058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88590369-e94b-440c-b4e9-1c7e18580e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.509666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88590369-e94b-440c-b4e9-1c7e18580e29 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.509942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88590369-e94b-440c-b4e9-1c7e18580e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.510208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88590369-e94b-440c-b4e9-1c7e18580e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.579813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88590369-e94b-440c-b4e9-1c7e18580e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.581260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88590369-e94b-440c-b4e9-1c7e18580e29 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.659119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770fb4-ed0d-48cf-a097-cca842afc172 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.659443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770fb4-ed0d-48cf-a097-cca842afc172 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.659673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770fb4-ed0d-48cf-a097-cca842afc172 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.661294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 515/1040] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:39.666071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056daa2-9c96-47e0-9be9-a69e379ef741 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.666071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056daa2-9c96-47e0-9be9-a69e379ef741 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.667197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056daa2-9c96-47e0-9be9-a69e379ef741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.683258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 526/1041] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:22:39.686034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9056daa2-9c96-47e0-9be9-a69e379ef741 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:39.687384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9056daa2-9c96-47e0-9be9-a69e379ef741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:39.689618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88590369-e94b-440c-b4e9-1c7e18580e29 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.723298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:39.766103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 516/1042] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:39.799567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88590369-e94b-440c-b4e9-1c7e18580e29 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.833749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029417-f486-4c1c-a68f-1f78c75a0038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.834375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029417-f486-4c1c-a68f-1f78c75a0038 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.834651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029417-f486-4c1c-a68f-1f78c75a0038 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.835007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029417-f486-4c1c-a68f-1f78c75a0038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.845008 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029417-f486-4c1c-a68f-1f78c75a0038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.846497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029417-f486-4c1c-a68f-1f78c75a0038 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fc029417-f486-4c1c-a68f-1f78c75a0038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:39.861819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:39.862770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:39.863659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:39.863659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:39.863659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:39.866984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 527/1043] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:39.868463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056daa2-9c96-47e0-9be9-a69e379ef741 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.877991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:39.969232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056daa2-9c96-47e0-9be9-a69e379ef741 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.003841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e830-f619-4ebb-b1be-5c6a380c8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.004450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e830-f619-4ebb-b1be-5c6a380c8e2a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.004727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e830-f619-4ebb-b1be-5c6a380c8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.004998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e830-f619-4ebb-b1be-5c6a380c8e2a None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.005635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e830-f619-4ebb-b1be-5c6a380c8e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:40.005939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e830-f619-4ebb-b1be-5c6a380c8e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.007370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e830-f619-4ebb-b1be-5c6a380c8e2a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.023035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 517/1044] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:40.024526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029417-f486-4c1c-a68f-1f78c75a0038 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.034567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e830-f619-4ebb-b1be-5c6a380c8e2a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.105136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:40.109507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:40.129472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029417-f486-4c1c-a68f-1f78c75a0038 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.144547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e830-f619-4ebb-b1be-5c6a380c8e2a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.165210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbe547-2cab-4438-bac0-8f2c3321e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.165965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbe547-2cab-4438-bac0-8f2c3321e04c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.166249 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbe547-2cab-4438-bac0-8f2c3321e04c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.166522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbe547-2cab-4438-bac0-8f2c3321e04c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.174650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbe547-2cab-4438-bac0-8f2c3321e04c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.176235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbe547-2cab-4438-bac0-8f2c3321e04c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.180047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c2c0-271f-4a54-a60f-7a346b552855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.180693 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c2c0-271f-4a54-a60f-7a346b552855 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.180970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c2c0-271f-4a54-a60f-7a346b552855 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.181237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c2c0-271f-4a54-a60f-7a346b552855 None admin] PATH_INFO: `/v3/services/image` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.181808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c2c0-271f-4a54-a60f-7a346b552855 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.183173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c2c0-271f-4a54-a60f-7a346b552855 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-98dbe547-2cab-4438-bac0-8f2c3321e04c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:40.187944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:40.188810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:40.189704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:40.189704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:40.189704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:40.189704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:40.189704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:40.189704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:40.189704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:40.189704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:40.189704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 528/1045] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:40.194801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbe547-2cab-4438-bac0-8f2c3321e04c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-0033c2c0-271f-4a54-a60f-7a346b552855 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:40.196841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:40.197790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:40.199390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 518/1046] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 31 11:22:40 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:40.205726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c2c0-271f-4a54-a60f-7a346b552855 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.310520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c2c0-271f-4a54-a60f-7a346b552855 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.312013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbe547-2cab-4438-bac0-8f2c3321e04c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.338969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:40.345940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f4641-28a6-4dcb-bd02-b9fa4aa96800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.346548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f4641-28a6-4dcb-bd02-b9fa4aa96800 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.346866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f4641-28a6-4dcb-bd02-b9fa4aa96800 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.347142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f4641-28a6-4dcb-bd02-b9fa4aa96800 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.348020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f4641-28a6-4dcb-bd02-b9fa4aa96800 None admin] RBAC: Adding query filter params (name=image) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:40.348321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f4641-28a6-4dcb-bd02-b9fa4aa96800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.349144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ed38b-af6a-4663-acbc-74cb7d836a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.349691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f4641-28a6-4dcb-bd02-b9fa4aa96800 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.349789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ed38b-af6a-4663-acbc-74cb7d836a85 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.350011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ed38b-af6a-4663-acbc-74cb7d836a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.350308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ed38b-af6a-4663-acbc-74cb7d836a85 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.351076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ed38b-af6a-4663-acbc-74cb7d836a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:40.351384 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ed38b-af6a-4663-acbc-74cb7d836a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.352808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ed38b-af6a-4663-acbc-74cb7d836a85 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.358721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 519/1047] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:40.360982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f4641-28a6-4dcb-bd02-b9fa4aa96800 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.366168 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:40.374723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 529/1048] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:40.375808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ed38b-af6a-4663-acbc-74cb7d836a85 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.467910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f4641-28a6-4dcb-bd02-b9fa4aa96800 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.478142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ed38b-af6a-4663-acbc-74cb7d836a85 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.506603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d574-2c73-453a-8363-0b796a9f3766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.507340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d574-2c73-453a-8363-0b796a9f3766 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.507623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d574-2c73-453a-8363-0b796a9f3766 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.507901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d574-2c73-453a-8363-0b796a9f3766 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.508528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d574-2c73-453a-8363-0b796a9f3766 None admin] RBAC: Adding query filter params (type=image) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:40.508831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d574-2c73-453a-8363-0b796a9f3766 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.510187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d574-2c73-453a-8363-0b796a9f3766 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.515066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 520/1049] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:40.515811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af0aed-2675-45a0-b099-5541cdfe0276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.516422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af0aed-2675-45a0-b099-5541cdfe0276 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.516703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af0aed-2675-45a0-b099-5541cdfe0276 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.516974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af0aed-2675-45a0-b099-5541cdfe0276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.517702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af0aed-2675-45a0-b099-5541cdfe0276 None admin] RBAC: Adding query filter params (role.id=ca0823b45e484a0ca722ad52ab8804cf, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=76462c2e1ec447acbd2aba9e77ae00b1) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:40.518009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af0aed-2675-45a0-b099-5541cdfe0276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.519481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af0aed-2675-45a0-b099-5541cdfe0276 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.521027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d574-2c73-453a-8363-0b796a9f3766 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.525166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 530/1050] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:40 2022] GET /identity/v3/role_assignments?user.id=76462c2e1ec447acbd2aba9e77ae00b1&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=ca0823b45e484a0ca722ad52ab8804cf => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:40.587337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:40.634282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d574-2c73-453a-8363-0b796a9f3766 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.677734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e3f35-4b5b-4725-a523-268e80ca1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.677734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e3f35-4b5b-4725-a523-268e80ca1507 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.677734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e3f35-4b5b-4725-a523-268e80ca1507 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.677999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e3f35-4b5b-4725-a523-268e80ca1507 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.678606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e3f35-4b5b-4725-a523-268e80ca1507 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.680001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e3f35-4b5b-4725-a523-268e80ca1507 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.705462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 521/1051] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:41.098794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92bf6b-cd2a-413f-83df-14121babc575 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:41.099171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92bf6b-cd2a-413f-83df-14121babc575 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:41.099347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92bf6b-cd2a-413f-83df-14121babc575 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:41.100726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 531/1052] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:41.105736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1870-1104-4cb2-82a8-25dd69d3d13d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:41.106189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1870-1104-4cb2-82a8-25dd69d3d13d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:41.106273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1870-1104-4cb2-82a8-25dd69d3d13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:41.126464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e43f1870-1104-4cb2-82a8-25dd69d3d13d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:41.127678 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e43f1870-1104-4cb2-82a8-25dd69d3d13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:41.202871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 522/1053] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:41.484348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92bf6b-cd2a-413f-83df-14121babc575 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:41.551250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:41.594334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92bf6b-cd2a-413f-83df-14121babc575 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:41.631708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01f20-b7b5-4249-9a96-4823046e7880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:41.632339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01f20-b7b5-4249-9a96-4823046e7880 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:41.632612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01f20-b7b5-4249-9a96-4823046e7880 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:41.632878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01f20-b7b5-4249-9a96-4823046e7880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:41.643550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf01f20-b7b5-4249-9a96-4823046e7880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7cf01f20-b7b5-4249-9a96-4823046e7880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:41.648486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:41.649414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:41.650255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 532/1054] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:41.658352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1870-1104-4cb2-82a8-25dd69d3d13d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:41.706994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:41.769304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1870-1104-4cb2-82a8-25dd69d3d13d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:41.806831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c12bc5-a088-450a-ae28-697dbc216b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:41.807439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c12bc5-a088-450a-ae28-697dbc216b5a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:41.807714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c12bc5-a088-450a-ae28-697dbc216b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:41.807981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c12bc5-a088-450a-ae28-697dbc216b5a None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:41.808644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c12bc5-a088-450a-ae28-697dbc216b5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:41.808944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c12bc5-a088-450a-ae28-697dbc216b5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:41.810355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c12bc5-a088-450a-ae28-697dbc216b5a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:41.824096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 523/1055] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:22:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:41.825315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01f20-b7b5-4249-9a96-4823046e7880 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:41.927837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01f20-b7b5-4249-9a96-4823046e7880 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:41.950330 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:41.962619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d632-489b-441e-a4e2-b2374cffc8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:41.963277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d632-489b-441e-a4e2-b2374cffc8ea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:41.963551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d632-489b-441e-a4e2-b2374cffc8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:41.963818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d632-489b-441e-a4e2-b2374cffc8ea None admin] PATH_INFO: `/v3/users/d96c26e5709e41319a846876e9943756` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:41.977986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d632-489b-441e-a4e2-b2374cffc8ea None admin] RBAC: Authorizing `identity:get_user(user_id=d96c26e5709e41319a846876e9943756)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:41.979466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d632-489b-441e-a4e2-b2374cffc8ea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:41.981252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 533/1056] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:22:41 2022] GET /identity/v3/users/d96c26e5709e41319a846876e9943756 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:41.986971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c12bc5-a088-450a-ae28-697dbc216b5a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:42.087988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c12bc5-a088-450a-ae28-697dbc216b5a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:42.089417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:42.124191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e459-e99f-4406-8273-8b2a79d1793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:42.124999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e459-e99f-4406-8273-8b2a79d1793f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.125081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e459-e99f-4406-8273-8b2a79d1793f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.125355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e459-e99f-4406-8273-8b2a79d1793f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.192614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1e459-e99f-4406-8273-8b2a79d1793f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:42.194047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1e459-e99f-4406-8273-8b2a79d1793f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:42.296098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 524/1057] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:22:42.297614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d632-489b-441e-a4e2-b2374cffc8ea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:42.398831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d632-489b-441e-a4e2-b2374cffc8ea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:42.424751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1277f3c-2fbe-4d22-a2e2-a16d8ba01cb2 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.425083 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1277f3c-2fbe-4d22-a2e2-a16d8ba01cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.425313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1277f3c-2fbe-4d22-a2e2-a16d8ba01cb2 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.426648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 525/1058] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:42.431633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4574ac-4476-4b4d-9bbe-caedfcb83734 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.431925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4574ac-4476-4b4d-9bbe-caedfcb83734 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.432202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4574ac-4476-4b4d-9bbe-caedfcb83734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.433950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf912-2a12-4275-9dfe-d1194125fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:42.434582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf912-2a12-4275-9dfe-d1194125fba0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.434893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf912-2a12-4275-9dfe-d1194125fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.435176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf912-2a12-4275-9dfe-d1194125fba0 None admin] PATH_INFO: `/v3/projects/61c6294452e2469fa7d1f5438f6cefa1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.436852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cf912-2a12-4275-9dfe-d1194125fba0 None admin] RBAC: Authorizing `identity:get_project(project_id=61c6294452e2469fa7d1f5438f6cefa1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:42.438290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cf912-2a12-4275-9dfe-d1194125fba0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:42.439301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:42.442721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 534/1059] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:22:42 2022] GET /identity/v3/projects/61c6294452e2469fa7d1f5438f6cefa1 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:42.446088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf912-2a12-4275-9dfe-d1194125fba0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:42.454830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9a4574ac-4476-4b4d-9bbe-caedfcb83734 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:42.456058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9a4574ac-4476-4b4d-9bbe-caedfcb83734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:42.500893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:42.538876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 526/1060] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:42.559247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf912-2a12-4275-9dfe-d1194125fba0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:42.593737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3a16c-76c4-418a-b5bf-12c896b53a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:42.594338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3a16c-76c4-418a-b5bf-12c896b53a0e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.594612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3a16c-76c4-418a-b5bf-12c896b53a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.594917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3a16c-76c4-418a-b5bf-12c896b53a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.595634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3a16c-76c4-418a-b5bf-12c896b53a0e None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=61c6294452e2469fa7d1f5438f6cefa1, user.id=d96c26e5709e41319a846876e9943756) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:42.595939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3a16c-76c4-418a-b5bf-12c896b53a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:42.597360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3a16c-76c4-418a-b5bf-12c896b53a0e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:42.603341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 535/1061] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:42 2022] GET /identity/v3/role_assignments?user.id=d96c26e5709e41319a846876e9943756&scope.project.id=61c6294452e2469fa7d1f5438f6cefa1&role.id=946af2ff291349299db56e09aacb6b03 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:42.637940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca140b4-94db-4244-ab2a-9c7d82de27d8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.638266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca140b4-94db-4244-ab2a-9c7d82de27d8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.639353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca140b4-94db-4244-ab2a-9c7d82de27d8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.640760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 527/1062] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:42.646561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70044806-ad27-42da-af61-69cafbd44264 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.646865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70044806-ad27-42da-af61-69cafbd44264 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.647148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70044806-ad27-42da-af61-69cafbd44264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.667066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-70044806-ad27-42da-af61-69cafbd44264 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:42.669473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-70044806-ad27-42da-af61-69cafbd44264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:42.744111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 536/1063] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:42.828675 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca140b4-94db-4244-ab2a-9c7d82de27d8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:42.940326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca140b4-94db-4244-ab2a-9c7d82de27d8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:42.969071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:42.975499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e0a1-2f38-471b-b49a-34f397f96a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:42.976178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e0a1-2f38-471b-b49a-34f397f96a40 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.976453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e0a1-2f38-471b-b49a-34f397f96a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.976721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e0a1-2f38-471b-b49a-34f397f96a40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.987515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1e0a1-2f38-471b-b49a-34f397f96a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f0d1e0a1-2f38-471b-b49a-34f397f96a40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:42.992246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:42.993243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:42.995689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 528/1064] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 31 11:22:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:43.000188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70044806-ad27-42da-af61-69cafbd44264 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.013164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e0a1-2f38-471b-b49a-34f397f96a40 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.048741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.109446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70044806-ad27-42da-af61-69cafbd44264 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.118178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e0a1-2f38-471b-b49a-34f397f96a40 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.145753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd47ead-c5ee-460e-a724-75a5b491a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.146226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47ead-c5ee-460e-a724-75a5b491a454 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.146510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47ead-c5ee-460e-a724-75a5b491a454 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.146879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47ead-c5ee-460e-a724-75a5b491a454 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.147492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd47ead-c5ee-460e-a724-75a5b491a454 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:43.147796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd47ead-c5ee-460e-a724-75a5b491a454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.149167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd47ead-c5ee-460e-a724-75a5b491a454 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.153918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb7e4-8cf1-4f7c-8d8f-f106fa6b1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.155096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb7e4-8cf1-4f7c-8d8f-f106fa6b1647 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.155377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb7e4-8cf1-4f7c-8d8f-f106fa6b1647 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.155652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb7e4-8cf1-4f7c-8d8f-f106fa6b1647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.163226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 537/1065] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 31 11:22:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:43.164303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd47ead-c5ee-460e-a724-75a5b491a454 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.219433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.230490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb7e4-8cf1-4f7c-8d8f-f106fa6b1647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.231982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb7e4-8cf1-4f7c-8d8f-f106fa6b1647 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.276423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd47ead-c5ee-460e-a724-75a5b491a454 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.285133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.314872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25846213-fef9-4e63-85af-272994f1210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.315803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846213-fef9-4e63-85af-272994f1210a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.316088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846213-fef9-4e63-85af-272994f1210a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.316362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846213-fef9-4e63-85af-272994f1210a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.328242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25846213-fef9-4e63-85af-272994f1210a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.329704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25846213-fef9-4e63-85af-272994f1210a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.335185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 529/1066] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 11:22:43.340842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb7e4-8cf1-4f7c-8d8f-f106fa6b1647 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-25846213-fef9-4e63-85af-272994f1210a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:43.344691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:43.345831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:43.346799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:43.346799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:43.346799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:43.346799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 538/1067] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:43.351665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25846213-fef9-4e63-85af-272994f1210a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.444060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.454041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb7e4-8cf1-4f7c-8d8f-f106fa6b1647 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.458921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25846213-fef9-4e63-85af-272994f1210a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.492652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c84da-e271-4144-a700-a54d77da3497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.493285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c84da-e271-4144-a700-a54d77da3497 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.493562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c84da-e271-4144-a700-a54d77da3497 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.493903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c84da-e271-4144-a700-a54d77da3497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.495147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92062a-6317-4f20-a66c-aa1691983a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.495914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92062a-6317-4f20-a66c-aa1691983a92 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.496188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92062a-6317-4f20-a66c-aa1691983a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.496770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92062a-6317-4f20-a66c-aa1691983a92 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.497423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92062a-6317-4f20-a66c-aa1691983a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:43.497726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92062a-6317-4f20-a66c-aa1691983a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.499780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92062a-6317-4f20-a66c-aa1691983a92 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.504608 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c84da-e271-4144-a700-a54d77da3497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.506092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c84da-e271-4144-a700-a54d77da3497 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.512424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 539/1068] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:43.518574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92062a-6317-4f20-a66c-aa1691983a92 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fb7c84da-e271-4144-a700-a54d77da3497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:43.521886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:43.522873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:43.523756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:43.523756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:43.523756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:43.523756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 530/1069] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:43.528817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c84da-e271-4144-a700-a54d77da3497 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.541106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.632694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c84da-e271-4144-a700-a54d77da3497 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.634348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92062a-6317-4f20-a66c-aa1691983a92 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.669917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5ea6-d18f-4267-8377-51c925e37978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.670450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5ea6-d18f-4267-8377-51c925e37978 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.670753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5ea6-d18f-4267-8377-51c925e37978 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.671032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5ea6-d18f-4267-8377-51c925e37978 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.671681 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a5ea6-d18f-4267-8377-51c925e37978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:43.671983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a5ea6-d18f-4267-8377-51c925e37978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.673354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a5ea6-d18f-4267-8377-51c925e37978 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.676550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae426c-16f8-435e-b1ca-e966b1551433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.677177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae426c-16f8-435e-b1ca-e966b1551433 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.677451 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae426c-16f8-435e-b1ca-e966b1551433 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.677720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae426c-16f8-435e-b1ca-e966b1551433 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.685085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae426c-16f8-435e-b1ca-e966b1551433 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.685989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 531/1070] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:43.686855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae426c-16f8-435e-b1ca-e966b1551433 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-28ae426c-16f8-435e-b1ca-e966b1551433 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:43.707652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:43.708724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:43.709684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:43.714024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 540/1071] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 31 11:22:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:43.715388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5ea6-d18f-4267-8377-51c925e37978 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.720993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.825313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5ea6-d18f-4267-8377-51c925e37978 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.864114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67259c-d625-49f7-adeb-2f62d0bde245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.864715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67259c-d625-49f7-adeb-2f62d0bde245 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.865044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67259c-d625-49f7-adeb-2f62d0bde245 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.865317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67259c-d625-49f7-adeb-2f62d0bde245 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.866041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67259c-d625-49f7-adeb-2f62d0bde245 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:43.866355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67259c-d625-49f7-adeb-2f62d0bde245 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.867776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67259c-d625-49f7-adeb-2f62d0bde245 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.885919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 532/1072] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 31 11:22:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:43.892637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae426c-16f8-435e-b1ca-e966b1551433 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.975970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.998627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae426c-16f8-435e-b1ca-e966b1551433 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.033106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badd54-1a54-4b0d-885c-2195cf84bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.033106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badd54-1a54-4b0d-885c-2195cf84bbec None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.033106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badd54-1a54-4b0d-885c-2195cf84bbec None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.033457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badd54-1a54-4b0d-885c-2195cf84bbec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.043831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62badd54-1a54-4b0d-885c-2195cf84bbec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.045363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62badd54-1a54-4b0d-885c-2195cf84bbec None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-62badd54-1a54-4b0d-885c-2195cf84bbec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:44.059600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:44.061424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:44.062316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:44.062316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:44.062316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:44.062316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 541/1073] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:44.067242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67259c-d625-49f7-adeb-2f62d0bde245 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:44.127589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:44.166349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67259c-d625-49f7-adeb-2f62d0bde245 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.201162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d078b-8825-4114-a132-647ce53078cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.201954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d078b-8825-4114-a132-647ce53078cc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.202325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d078b-8825-4114-a132-647ce53078cc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.202669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d078b-8825-4114-a132-647ce53078cc None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.203323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d078b-8825-4114-a132-647ce53078cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:44.203614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d078b-8825-4114-a132-647ce53078cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.204960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d078b-8825-4114-a132-647ce53078cc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.216082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 533/1074] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:44.221745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badd54-1a54-4b0d-885c-2195cf84bbec None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:44.321196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badd54-1a54-4b0d-885c-2195cf84bbec None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.348832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:44.354941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083e69-a1e4-4e53-b9a8-b7b7a87c57da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.355563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083e69-a1e4-4e53-b9a8-b7b7a87c57da None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.355837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083e69-a1e4-4e53-b9a8-b7b7a87c57da None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.356105 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083e69-a1e4-4e53-b9a8-b7b7a87c57da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.363446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98083e69-a1e4-4e53-b9a8-b7b7a87c57da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.364883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98083e69-a1e4-4e53-b9a8-b7b7a87c57da None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-98083e69-a1e4-4e53-b9a8-b7b7a87c57da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:44.376740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:44.377811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:44.379092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:44.379092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:44.379092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:44.379092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:44.379092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:44.379092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:44.379092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:44.379092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:44.379092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 542/1075] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:44.383627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d078b-8825-4114-a132-647ce53078cc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:44.479844 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d078b-8825-4114-a132-647ce53078cc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.502137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:44.514070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642e647-7c81-4260-a60f-1a2230d344fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.514676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e647-7c81-4260-a60f-1a2230d344fb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.514990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e647-7c81-4260-a60f-1a2230d344fb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.515266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e647-7c81-4260-a60f-1a2230d344fb None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.515955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642e647-7c81-4260-a60f-1a2230d344fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:44.516264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642e647-7c81-4260-a60f-1a2230d344fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.517688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642e647-7c81-4260-a60f-1a2230d344fb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.530182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 534/1076] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:44.536243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083e69-a1e4-4e53-b9a8-b7b7a87c57da None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:44.568326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1200d-7c91-4880-8ddf-9edbcaebdadd None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.568609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1200d-7c91-4880-8ddf-9edbcaebdadd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.568885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1200d-7c91-4880-8ddf-9edbcaebdadd None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.570204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 535/1077] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:22:44.575040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f739a-346e-426c-84ab-6bd4373e07d7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.575327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f739a-346e-426c-84ab-6bd4373e07d7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.575605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f739a-346e-426c-84ab-6bd4373e07d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.593749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a66f739a-346e-426c-84ab-6bd4373e07d7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:44.594978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a66f739a-346e-426c-84ab-6bd4373e07d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:44.636794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083e69-a1e4-4e53-b9a8-b7b7a87c57da None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.664372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 536/1078] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:44.671929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae8f4-26d6-4db6-9c32-9750cf326ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.672094 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae8f4-26d6-4db6-9c32-9750cf326ed3 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.672372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae8f4-26d6-4db6-9c32-9750cf326ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.672645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae8f4-26d6-4db6-9c32-9750cf326ed3 None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/76462c2e1ec447acbd2aba9e77ae00b1/roles/ca0823b45e484a0ca722ad52ab8804cf` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.674780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ae8f4-26d6-4db6-9c32-9750cf326ed3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=76462c2e1ec447acbd2aba9e77ae00b1, role_id=ca0823b45e484a0ca722ad52ab8804cf)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.676226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ae8f4-26d6-4db6-9c32-9750cf326ed3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.689122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 543/1079] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:22:44 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/76462c2e1ec447acbd2aba9e77ae00b1/roles/ca0823b45e484a0ca722ad52ab8804cf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:44.933213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f739a-346e-426c-84ab-6bd4373e07d7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:45.031605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f739a-346e-426c-84ab-6bd4373e07d7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:45.044317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:45.066096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbe3b3-9adf-4c86-a84a-d17e931cfab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:45.066743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbe3b3-9adf-4c86-a84a-d17e931cfab0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:45.067021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbe3b3-9adf-4c86-a84a-d17e931cfab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:45.067287 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbe3b3-9adf-4c86-a84a-d17e931cfab0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:45.077052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbe3b3-9adf-4c86-a84a-d17e931cfab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-49bbe3b3-9adf-4c86-a84a-d17e931cfab0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:45.081747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:45.082718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:45.083599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 537/1080] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:45.088767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae8f4-26d6-4db6-9c32-9750cf326ed3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:45.139597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:45.191355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae8f4-26d6-4db6-9c32-9750cf326ed3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:45.224243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f60b0-e56d-4e48-9487-dd92f5c40e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:45.224843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f60b0-e56d-4e48-9487-dd92f5c40e41 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:45.225123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f60b0-e56d-4e48-9487-dd92f5c40e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:45.225392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f60b0-e56d-4e48-9487-dd92f5c40e41 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:45.226044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f60b0-e56d-4e48-9487-dd92f5c40e41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:45.226344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f60b0-e56d-4e48-9487-dd92f5c40e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:45.227752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f60b0-e56d-4e48-9487-dd92f5c40e41 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:45.243033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 544/1081] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:22:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:45.249502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbe3b3-9adf-4c86-a84a-d17e931cfab0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:45.347135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbe3b3-9adf-4c86-a84a-d17e931cfab0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:45.379789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128feb9-21d4-44ea-8973-23bc940fd4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:45.380405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128feb9-21d4-44ea-8973-23bc940fd4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:45.380683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128feb9-21d4-44ea-8973-23bc940fd4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:45.380950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128feb9-21d4-44ea-8973-23bc940fd4c4 None admin] PATH_INFO: `/v3/users/d96c26e5709e41319a846876e9943756` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:45.382055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128feb9-21d4-44ea-8973-23bc940fd4c4 None admin] RBAC: Authorizing `identity:get_user(user_id=d96c26e5709e41319a846876e9943756)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:45.383511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128feb9-21d4-44ea-8973-23bc940fd4c4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:45.385079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 538/1082] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:22:45 2022] GET /identity/v3/users/d96c26e5709e41319a846876e9943756 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:45.390888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f60b0-e56d-4e48-9487-dd92f5c40e41 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:45.486649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f60b0-e56d-4e48-9487-dd92f5c40e41 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:45.501432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:45.522310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816e86c-a698-418f-9066-3928e26cc45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:45.522987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816e86c-a698-418f-9066-3928e26cc45a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:45.523253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816e86c-a698-418f-9066-3928e26cc45a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:45.523531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816e86c-a698-418f-9066-3928e26cc45a None admin] PATH_INFO: `/v3/projects/61c6294452e2469fa7d1f5438f6cefa1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:45.524642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816e86c-a698-418f-9066-3928e26cc45a None admin] RBAC: Authorizing `identity:get_project(project_id=61c6294452e2469fa7d1f5438f6cefa1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:45.526079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816e86c-a698-418f-9066-3928e26cc45a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:45.527751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 545/1083] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:22:45 2022] GET /identity/v3/projects/61c6294452e2469fa7d1f5438f6cefa1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:45.534150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128feb9-21d4-44ea-8973-23bc940fd4c4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:45.574700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:45.631714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128feb9-21d4-44ea-8973-23bc940fd4c4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:45.666492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01d9f5-06f0-4fc3-b82c-57d3836d721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:45.667174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d9f5-06f0-4fc3-b82c-57d3836d721e None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:45.667445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d9f5-06f0-4fc3-b82c-57d3836d721e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:45.667708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d9f5-06f0-4fc3-b82c-57d3836d721e None admin] PATH_INFO: `/v3/projects/61c6294452e2469fa7d1f5438f6cefa1/users/d96c26e5709e41319a846876e9943756/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:45.669594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01d9f5-06f0-4fc3-b82c-57d3836d721e None admin] RBAC: Authorizing `identity:create_grant(project_id=61c6294452e2469fa7d1f5438f6cefa1, user_id=d96c26e5709e41319a846876e9943756, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:45.671482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01d9f5-06f0-4fc3-b82c-57d3836d721e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:45.683872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 539/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:22:45 2022] PUT /identity/v3/projects/61c6294452e2469fa7d1f5438f6cefa1/users/d96c26e5709e41319a846876e9943756/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:46.587631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb44f2-43d0-4ff0-9109-671996d09ede None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:46.588169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb44f2-43d0-4ff0-9109-671996d09ede None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:46.588169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb44f2-43d0-4ff0-9109-671996d09ede None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:46.589516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 546/1085] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:46.594749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01eb9-4adf-4517-87e7-9a3596e38d37 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:46.595188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01eb9-4adf-4517-87e7-9a3596e38d37 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:46.595435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01eb9-4adf-4517-87e7-9a3596e38d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:46.614552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-04d01eb9-4adf-4517-87e7-9a3596e38d37 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:46.615748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-04d01eb9-4adf-4517-87e7-9a3596e38d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:46.682265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 540/1086] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:46.959792 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb44f2-43d0-4ff0-9109-671996d09ede None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:47.061200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb44f2-43d0-4ff0-9109-671996d09ede None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:47.094888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d421d2-c529-410d-b076-f7c7581ef403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:47.095516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d421d2-c529-410d-b076-f7c7581ef403 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.095796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d421d2-c529-410d-b076-f7c7581ef403 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.096066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d421d2-c529-410d-b076-f7c7581ef403 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.106283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d421d2-c529-410d-b076-f7c7581ef403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c1d421d2-c529-410d-b076-f7c7581ef403 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:47.111768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:47.112853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:22:47.113908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:47.120918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 547/1087] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 31 11:22:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:22:47.121054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01eb9-4adf-4517-87e7-9a3596e38d37 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:47.148527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:47.217115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01eb9-4adf-4517-87e7-9a3596e38d37 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:47.249937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837152f2-616b-462f-9660-313dfcb7d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:47.250537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837152f2-616b-462f-9660-313dfcb7d924 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.250849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837152f2-616b-462f-9660-313dfcb7d924 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.251120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837152f2-616b-462f-9660-313dfcb7d924 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.251774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837152f2-616b-462f-9660-313dfcb7d924 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:47.252073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837152f2-616b-462f-9660-313dfcb7d924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:47.253432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837152f2-616b-462f-9660-313dfcb7d924 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:47.261154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 541/1088] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 31 11:22:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:47.267292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d421d2-c529-410d-b076-f7c7581ef403 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:47.309010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:47.367861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d421d2-c529-410d-b076-f7c7581ef403 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:47.400956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f40a9-ef2e-491c-9300-e3745ecef8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:47.401583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f40a9-ef2e-491c-9300-e3745ecef8fa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.401863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f40a9-ef2e-491c-9300-e3745ecef8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.402133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f40a9-ef2e-491c-9300-e3745ecef8fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.412708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f40a9-ef2e-491c-9300-e3745ecef8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:47.414145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f40a9-ef2e-491c-9300-e3745ecef8fa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-926f40a9-ef2e-491c-9300-e3745ecef8fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:47.428567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:47.429572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:47.430942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:47.430942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:47.430942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:47.430942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 548/1089] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:47.436277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837152f2-616b-462f-9660-313dfcb7d924 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:47.525424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:47.534922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837152f2-616b-462f-9660-313dfcb7d924 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:47.567447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c1e5c-d25a-44fe-958f-ab5ecc8c2314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:47.568040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c1e5c-d25a-44fe-958f-ab5ecc8c2314 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.568314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c1e5c-d25a-44fe-958f-ab5ecc8c2314 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.568580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c1e5c-d25a-44fe-958f-ab5ecc8c2314 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.569215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c1e5c-d25a-44fe-958f-ab5ecc8c2314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:47.569510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c1e5c-d25a-44fe-958f-ab5ecc8c2314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:47.570891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c1e5c-d25a-44fe-958f-ab5ecc8c2314 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:47.577971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86711a-d583-49cb-853d-ce93d6a4dc6f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.578258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86711a-d583-49cb-853d-ce93d6a4dc6f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.578527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86711a-d583-49cb-853d-ce93d6a4dc6f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.579905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 549/1090] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:47.582312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 542/1091] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:47.584790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f8de1-a3a0-4757-a7b2-e965b7e53726 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.585073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f8de1-a3a0-4757-a7b2-e965b7e53726 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.585351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f8de1-a3a0-4757-a7b2-e965b7e53726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.587872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c1e5c-d25a-44fe-958f-ab5ecc8c2314 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:47.604333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b83f8de1-a3a0-4757-a7b2-e965b7e53726 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:47.605525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b83f8de1-a3a0-4757-a7b2-e965b7e53726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:47.673416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 550/1092] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:47.686659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c1e5c-d25a-44fe-958f-ab5ecc8c2314 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:47.721169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8455033-56ac-403f-8146-d02d34a20c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:47.721784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8455033-56ac-403f-8146-d02d34a20c05 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.722061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8455033-56ac-403f-8146-d02d34a20c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.722328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8455033-56ac-403f-8146-d02d34a20c05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.729657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8455033-56ac-403f-8146-d02d34a20c05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:47.731127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8455033-56ac-403f-8146-d02d34a20c05 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-b8455033-56ac-403f-8146-d02d34a20c05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:22:47.743164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:47.744203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:47.745221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 543/1093] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 31 11:22:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:47.750158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f8de1-a3a0-4757-a7b2-e965b7e53726 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:47.773678 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:47.848511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f8de1-a3a0-4757-a7b2-e965b7e53726 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:47.881342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fe7e2-239a-43e3-aa18-b9cbf36ca438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:47.881948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fe7e2-239a-43e3-aa18-b9cbf36ca438 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.882226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fe7e2-239a-43e3-aa18-b9cbf36ca438 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.882497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fe7e2-239a-43e3-aa18-b9cbf36ca438 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.883261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fe7e2-239a-43e3-aa18-b9cbf36ca438 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:47.883565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fe7e2-239a-43e3-aa18-b9cbf36ca438 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:47.885002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fe7e2-239a-43e3-aa18-b9cbf36ca438 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:47.902111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 551/1094] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 31 11:22:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:47.908557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8455033-56ac-403f-8146-d02d34a20c05 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:47.923719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:47.938140 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fe7e2-239a-43e3-aa18-b9cbf36ca438 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.007520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8455033-56ac-403f-8146-d02d34a20c05 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.017531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.037689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fe7e2-239a-43e3-aa18-b9cbf36ca438 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.042891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92fcf6-4e91-4825-a00c-89902cc9be34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.043496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92fcf6-4e91-4825-a00c-89902cc9be34 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.043774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92fcf6-4e91-4825-a00c-89902cc9be34 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.044045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92fcf6-4e91-4825-a00c-89902cc9be34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.070431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3a632-c796-47d6-8dc9-ea973b9fed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.071067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3a632-c796-47d6-8dc9-ea973b9fed9c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.071343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3a632-c796-47d6-8dc9-ea973b9fed9c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.071609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3a632-c796-47d6-8dc9-ea973b9fed9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.082274 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3a632-c796-47d6-8dc9-ea973b9fed9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-42f3a632-c796-47d6-8dc9-ea973b9fed9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:22:48.087021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:48.088147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:22:48.089142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 552/1095] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:22:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:48.094459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3a632-c796-47d6-8dc9-ea973b9fed9c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.111433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92fcf6-4e91-4825-a00c-89902cc9be34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.112815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92fcf6-4e91-4825-a00c-89902cc9be34 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.126073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.193109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3a632-c796-47d6-8dc9-ea973b9fed9c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.210768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 544/1096] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 11:22:48.216524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92fcf6-4e91-4825-a00c-89902cc9be34 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.228143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696b02c-5588-4d10-acc4-853a6c5597d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.228742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b02c-5588-4d10-acc4-853a6c5597d6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.229016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b02c-5588-4d10-acc4-853a6c5597d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.229287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b02c-5588-4d10-acc4-853a6c5597d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.229939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696b02c-5588-4d10-acc4-853a6c5597d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:48.230237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696b02c-5588-4d10-acc4-853a6c5597d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.231659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696b02c-5588-4d10-acc4-853a6c5597d6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.239586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 553/1097] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:48.245101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696b02c-5588-4d10-acc4-853a6c5597d6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.247608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.315861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92fcf6-4e91-4825-a00c-89902cc9be34 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.329039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.343767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696b02c-5588-4d10-acc4-853a6c5597d6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.350920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb02a0-1f96-4226-a335-91fb25997879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.351542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb02a0-1f96-4226-a335-91fb25997879 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.351819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb02a0-1f96-4226-a335-91fb25997879 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.352091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb02a0-1f96-4226-a335-91fb25997879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.361835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb02a0-1f96-4226-a335-91fb25997879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.363248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb02a0-1f96-4226-a335-91fb25997879 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.376846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0edab4-3d50-4c33-88fa-b8aee05bafe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.377462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0edab4-3d50-4c33-88fa-b8aee05bafe1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.377738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0edab4-3d50-4c33-88fa-b8aee05bafe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-bbeb02a0-1f96-4226-a335-91fb25997879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:22:48.377868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:48.378920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:22:48.380150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:22:48.380150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:22:48.380150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:48.380372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0edab4-3d50-4c33-88fa-b8aee05bafe1 None admin] PATH_INFO: `/v3/users/d96c26e5709e41319a846876e9943756` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.380457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 545/1098] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:48.380538 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0edab4-3d50-4c33-88fa-b8aee05bafe1 None admin] RBAC: Authorizing `identity:get_user(user_id=d96c26e5709e41319a846876e9943756)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.380646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0edab4-3d50-4c33-88fa-b8aee05bafe1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.386803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 554/1099] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/users/d96c26e5709e41319a846876e9943756 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:48.386930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb02a0-1f96-4226-a335-91fb25997879 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.387656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0edab4-3d50-4c33-88fa-b8aee05bafe1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.457797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.483811 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb02a0-1f96-4226-a335-91fb25997879 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.490294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0edab4-3d50-4c33-88fa-b8aee05bafe1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.517683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dad339-cd3e-46b2-91f1-bc3c2d9e0510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.518282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dad339-cd3e-46b2-91f1-bc3c2d9e0510 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.518562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dad339-cd3e-46b2-91f1-bc3c2d9e0510 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.518861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dad339-cd3e-46b2-91f1-bc3c2d9e0510 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.519496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dad339-cd3e-46b2-91f1-bc3c2d9e0510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:48.519796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dad339-cd3e-46b2-91f1-bc3c2d9e0510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.521159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dad339-cd3e-46b2-91f1-bc3c2d9e0510 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.525574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c9aa9-9b8a-4adf-a5e5-ce608c916959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.526184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9aa9-9b8a-4adf-a5e5-ce608c916959 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.526467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9aa9-9b8a-4adf-a5e5-ce608c916959 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.526769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9aa9-9b8a-4adf-a5e5-ce608c916959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.532639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 546/1100] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:48.538124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dad339-cd3e-46b2-91f1-bc3c2d9e0510 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.562479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.594990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c9aa9-9b8a-4adf-a5e5-ce608c916959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.596466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c9aa9-9b8a-4adf-a5e5-ce608c916959 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.635854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dad339-cd3e-46b2-91f1-bc3c2d9e0510 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.662836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.670898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f536b6-91d0-4ab4-a90d-b50f6cb14bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.671532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f536b6-91d0-4ab4-a90d-b50f6cb14bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.671811 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f536b6-91d0-4ab4-a90d-b50f6cb14bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.672403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f536b6-91d0-4ab4-a90d-b50f6cb14bd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.678895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f536b6-91d0-4ab4-a90d-b50f6cb14bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.680344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f536b6-91d0-4ab4-a90d-b50f6cb14bd8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e8f536b6-91d0-4ab4-a90d-b50f6cb14bd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:22:48.692850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:22:48.694269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:22:48.695214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:22:48.695214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:22:48.695214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:22:48.695214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:22:48.695214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:22:48.695214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:22:48.695214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:22:48.695214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:22:48.695214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 547/1101] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:22:48.699709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f536b6-91d0-4ab4-a90d-b50f6cb14bd8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.701543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 555/1102] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 11:22:48.707226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c9aa9-9b8a-4adf-a5e5-ce608c916959 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.783885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.800537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f536b6-91d0-4ab4-a90d-b50f6cb14bd8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.803712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c9aa9-9b8a-4adf-a5e5-ce608c916959 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.833570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319cf04-36fb-40f2-90d1-8226e7d72d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.834165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319cf04-36fb-40f2-90d1-8226e7d72d5a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.834440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319cf04-36fb-40f2-90d1-8226e7d72d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.834729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319cf04-36fb-40f2-90d1-8226e7d72d5a None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.835411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319cf04-36fb-40f2-90d1-8226e7d72d5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:48.835709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319cf04-36fb-40f2-90d1-8226e7d72d5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.837114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319cf04-36fb-40f2-90d1-8226e7d72d5a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.837210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cba5f6-4905-4be7-a17a-0b3038de3bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.837830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cba5f6-4905-4be7-a17a-0b3038de3bda None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.838110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cba5f6-4905-4be7-a17a-0b3038de3bda None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.838392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cba5f6-4905-4be7-a17a-0b3038de3bda None admin] PATH_INFO: `/v3/projects/61c6294452e2469fa7d1f5438f6cefa1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.839531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cba5f6-4905-4be7-a17a-0b3038de3bda None admin] RBAC: Authorizing `identity:get_project(project_id=61c6294452e2469fa7d1f5438f6cefa1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.840950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cba5f6-4905-4be7-a17a-0b3038de3bda None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.843195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 556/1103] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/projects/61c6294452e2469fa7d1f5438f6cefa1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:48.850599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 548/1104] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:48.851187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cba5f6-4905-4be7-a17a-0b3038de3bda None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.856251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319cf04-36fb-40f2-90d1-8226e7d72d5a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.891765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.952485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cba5f6-4905-4be7-a17a-0b3038de3bda None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.954015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319cf04-36fb-40f2-90d1-8226e7d72d5a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.986866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bad62-379f-4ef2-a83d-aae0b06fa861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.987448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bad62-379f-4ef2-a83d-aae0b06fa861 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.987722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bad62-379f-4ef2-a83d-aae0b06fa861 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.987997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bad62-379f-4ef2-a83d-aae0b06fa861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.988706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bad62-379f-4ef2-a83d-aae0b06fa861 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=61c6294452e2469fa7d1f5438f6cefa1, user.id=d96c26e5709e41319a846876e9943756) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:48.989007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bad62-379f-4ef2-a83d-aae0b06fa861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.989220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e9852-29b5-4b67-8484-74882d820f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.989818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e9852-29b5-4b67-8484-74882d820f68 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.990096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e9852-29b5-4b67-8484-74882d820f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.990366 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e9852-29b5-4b67-8484-74882d820f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.990467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bad62-379f-4ef2-a83d-aae0b06fa861 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.991121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e9852-29b5-4b67-8484-74882d820f68 None admin] RBAC: Adding query filter params (role.id=ca0823b45e484a0ca722ad52ab8804cf, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=76462c2e1ec447acbd2aba9e77ae00b1) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:48.991426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e9852-29b5-4b67-8484-74882d820f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.992827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e9852-29b5-4b67-8484-74882d820f68 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.996055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 557/1105] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/role_assignments?user.id=d96c26e5709e41319a846876e9943756&scope.project.id=61c6294452e2469fa7d1f5438f6cefa1&role.id=946af2ff291349299db56e09aacb6b03 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:49.002733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 549/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:48 2022] GET /identity/v3/role_assignments?user.id=76462c2e1ec447acbd2aba9e77ae00b1&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=ca0823b45e484a0ca722ad52ab8804cf => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:50.947735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7bc69-91b7-44c8-8bb2-05ab19e8bbde None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.948257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7bc69-91b7-44c8-8bb2-05ab19e8bbde None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.948257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7bc69-91b7-44c8-8bb2-05ab19e8bbde None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.949533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 558/1107] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:50.955276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140db07-a2fc-4e89-be95-d45299eb5806 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.955685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140db07-a2fc-4e89-be95-d45299eb5806 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.955818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140db07-a2fc-4e89-be95-d45299eb5806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.974294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8140db07-a2fc-4e89-be95-d45299eb5806 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:50.975491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8140db07-a2fc-4e89-be95-d45299eb5806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:50.977389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:51.043651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 550/1108] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:51.316735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7bc69-91b7-44c8-8bb2-05ab19e8bbde None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:51.416137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7bc69-91b7-44c8-8bb2-05ab19e8bbde None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.417613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:51.450159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d3a2a-22fe-4069-806e-fc1396deb96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.450847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3a2a-22fe-4069-806e-fc1396deb96b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.451621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3a2a-22fe-4069-806e-fc1396deb96b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.452063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3a2a-22fe-4069-806e-fc1396deb96b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.453177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d3a2a-22fe-4069-806e-fc1396deb96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.454612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d3a2a-22fe-4069-806e-fc1396deb96b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:51.456196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 559/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:22:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:51.461817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140db07-a2fc-4e89-be95-d45299eb5806 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:51.556545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140db07-a2fc-4e89-be95-d45299eb5806 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.605585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c76a12-1aba-4f0a-960b-e28831f3178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.606112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76a12-1aba-4f0a-960b-e28831f3178a None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.606388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76a12-1aba-4f0a-960b-e28831f3178a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.606659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76a12-1aba-4f0a-960b-e28831f3178a None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.607393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c76a12-1aba-4f0a-960b-e28831f3178a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.608806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c76a12-1aba-4f0a-960b-e28831f3178a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:51.618458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:51.631214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 551/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:22:51 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:53.543399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe964bb-e6a8-4771-bb0d-2f9f69b9bec0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.543925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe964bb-e6a8-4771-bb0d-2f9f69b9bec0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.544018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe964bb-e6a8-4771-bb0d-2f9f69b9bec0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.545333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 560/1111] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:53.551107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2481-c49c-4e4a-9679-442500ac5d68 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.551533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2481-c49c-4e4a-9679-442500ac5d68 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.551650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2481-c49c-4e4a-9679-442500ac5d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.569433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-19fb2481-c49c-4e4a-9679-442500ac5d68 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:53.570603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-19fb2481-c49c-4e4a-9679-442500ac5d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:53.635375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 552/1112] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:53.904126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe964bb-e6a8-4771-bb0d-2f9f69b9bec0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.004177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe964bb-e6a8-4771-bb0d-2f9f69b9bec0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.038125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5412a-d68c-46d8-881d-604bf97c1508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.038769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5412a-d68c-46d8-881d-604bf97c1508 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.039050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5412a-d68c-46d8-881d-604bf97c1508 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.039319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5412a-d68c-46d8-881d-604bf97c1508 None admin] PATH_INFO: `/v3/roles/d48e46bf2b814100a25f94d5cdffecfd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.040683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5412a-d68c-46d8-881d-604bf97c1508 None admin] RBAC: Authorizing `identity:get_role(role_id=d48e46bf2b814100a25f94d5cdffecfd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.042111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5412a-d68c-46d8-881d-604bf97c1508 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.043437 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 561/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:22:53 2022] GET /identity/v3/roles/d48e46bf2b814100a25f94d5cdffecfd => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:54.049754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2481-c49c-4e4a-9679-442500ac5d68 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.144481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2481-c49c-4e4a-9679-442500ac5d68 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.167175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:54.178536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a50c-797c-4b09-bcf0-507ae4eca0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.179180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a50c-797c-4b09-bcf0-507ae4eca0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.179458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a50c-797c-4b09-bcf0-507ae4eca0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.179729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a50c-797c-4b09-bcf0-507ae4eca0f3 None admin] PATH_INFO: `/v3/users/5dab8019ad5d4abfafe3dd2c673e866f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.193426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9a50c-797c-4b09-bcf0-507ae4eca0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=5dab8019ad5d4abfafe3dd2c673e866f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.194890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9a50c-797c-4b09-bcf0-507ae4eca0f3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.196465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 553/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:22:54 2022] GET /identity/v3/users/5dab8019ad5d4abfafe3dd2c673e866f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:54.202337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5412a-d68c-46d8-881d-604bf97c1508 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.241415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:54.300383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5412a-d68c-46d8-881d-604bf97c1508 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.332796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049d189-4845-43a8-8005-e490cb41457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.333394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049d189-4845-43a8-8005-e490cb41457b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.333677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049d189-4845-43a8-8005-e490cb41457b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.333952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049d189-4845-43a8-8005-e490cb41457b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.399314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049d189-4845-43a8-8005-e490cb41457b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.400762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049d189-4845-43a8-8005-e490cb41457b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.438835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:54.497215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 562/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:22:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:22:54.503228 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a50c-797c-4b09-bcf0-507ae4eca0f3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.598933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a50c-797c-4b09-bcf0-507ae4eca0f3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.631879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938833d9-e218-47c9-8e1f-0183a1b61c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.632498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938833d9-e218-47c9-8e1f-0183a1b61c12 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.632775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938833d9-e218-47c9-8e1f-0183a1b61c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.633051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938833d9-e218-47c9-8e1f-0183a1b61c12 None admin] PATH_INFO: `/v3/projects/61c6294452e2469fa7d1f5438f6cefa1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.634140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938833d9-e218-47c9-8e1f-0183a1b61c12 None admin] RBAC: Authorizing `identity:get_project(project_id=61c6294452e2469fa7d1f5438f6cefa1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.635603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938833d9-e218-47c9-8e1f-0183a1b61c12 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.637215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 554/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:22:54 2022] GET /identity/v3/projects/61c6294452e2469fa7d1f5438f6cefa1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:54.643899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049d189-4845-43a8-8005-e490cb41457b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.739908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049d189-4845-43a8-8005-e490cb41457b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.772873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b236e-f7bb-4224-8625-74cfa5eabafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.773464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b236e-f7bb-4224-8625-74cfa5eabafd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.773744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b236e-f7bb-4224-8625-74cfa5eabafd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.774019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b236e-f7bb-4224-8625-74cfa5eabafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.774762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b236e-f7bb-4224-8625-74cfa5eabafd None admin] RBAC: Adding query filter params (role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=61c6294452e2469fa7d1f5438f6cefa1, user.id=5dab8019ad5d4abfafe3dd2c673e866f) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:54.775072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b236e-f7bb-4224-8625-74cfa5eabafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.776504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b236e-f7bb-4224-8625-74cfa5eabafd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.782227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 563/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:22:54 2022] GET /identity/v3/role_assignments?user.id=5dab8019ad5d4abfafe3dd2c673e866f&scope.project.id=61c6294452e2469fa7d1f5438f6cefa1&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:56.644540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffed1f-b15c-4a4f-b7e2-8b6ba47a03db None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.645143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffed1f-b15c-4a4f-b7e2-8b6ba47a03db None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.645143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffed1f-b15c-4a4f-b7e2-8b6ba47a03db None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.646398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 555/1118] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:56.651542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf36ff-187e-4c9c-b7d8-1f677a2982e2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.651993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf36ff-187e-4c9c-b7d8-1f677a2982e2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.652091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf36ff-187e-4c9c-b7d8-1f677a2982e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.659057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:56.672498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5fbf36ff-187e-4c9c-b7d8-1f677a2982e2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:56.673720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fbf36ff-187e-4c9c-b7d8-1f677a2982e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:56.741818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 564/1119] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:22:57.007780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffed1f-b15c-4a4f-b7e2-8b6ba47a03db None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:57.057388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:57.106338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffed1f-b15c-4a4f-b7e2-8b6ba47a03db None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:57.139273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461339c-aed6-490f-ac03-383878a6afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:57.139884 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461339c-aed6-490f-ac03-383878a6afde None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:57.140157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461339c-aed6-490f-ac03-383878a6afde None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:57.140424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461339c-aed6-490f-ac03-383878a6afde None admin] PATH_INFO: `/v3/roles/d48e46bf2b814100a25f94d5cdffecfd` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:57.141795 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461339c-aed6-490f-ac03-383878a6afde None admin] RBAC: Authorizing `identity:get_role(role_id=d48e46bf2b814100a25f94d5cdffecfd)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:57.143195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461339c-aed6-490f-ac03-383878a6afde None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:57.144485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 556/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:22:57 2022] GET /identity/v3/roles/d48e46bf2b814100a25f94d5cdffecfd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:57.150226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf36ff-187e-4c9c-b7d8-1f677a2982e2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:57.245832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf36ff-187e-4c9c-b7d8-1f677a2982e2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:57.273736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:57.279430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355198bd-e1f4-4702-aa7c-5554338c6b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:57.280134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355198bd-e1f4-4702-aa7c-5554338c6b73 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:57.280407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355198bd-e1f4-4702-aa7c-5554338c6b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:57.280671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355198bd-e1f4-4702-aa7c-5554338c6b73 None admin] PATH_INFO: `/v3/users/5dab8019ad5d4abfafe3dd2c673e866f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:57.281774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355198bd-e1f4-4702-aa7c-5554338c6b73 None admin] RBAC: Authorizing `identity:get_user(user_id=5dab8019ad5d4abfafe3dd2c673e866f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:57.283252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355198bd-e1f4-4702-aa7c-5554338c6b73 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:57.284802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 565/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:22:57 2022] GET /identity/v3/users/5dab8019ad5d4abfafe3dd2c673e866f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:57.290595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461339c-aed6-490f-ac03-383878a6afde None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:57.386903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461339c-aed6-490f-ac03-383878a6afde None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:57.403375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:57.420897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8db2db-3346-46ca-8d90-a9b857cc13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:57.421506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db2db-3346-46ca-8d90-a9b857cc13f1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:57.421783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db2db-3346-46ca-8d90-a9b857cc13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:57.422051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db2db-3346-46ca-8d90-a9b857cc13f1 None admin] PATH_INFO: `/v3/projects/61c6294452e2469fa7d1f5438f6cefa1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:57.423167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8db2db-3346-46ca-8d90-a9b857cc13f1 None admin] RBAC: Authorizing `identity:get_project(project_id=61c6294452e2469fa7d1f5438f6cefa1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:57.424575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8db2db-3346-46ca-8d90-a9b857cc13f1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:57.426174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 557/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:22:57 2022] GET /identity/v3/projects/61c6294452e2469fa7d1f5438f6cefa1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:57.432142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355198bd-e1f4-4702-aa7c-5554338c6b73 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:57.527807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355198bd-e1f4-4702-aa7c-5554338c6b73 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:57.561151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15451-b7a8-4a64-ad7e-1a4c0622051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:57.561790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15451-b7a8-4a64-ad7e-1a4c0622051c None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:57.562069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15451-b7a8-4a64-ad7e-1a4c0622051c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:57.562340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15451-b7a8-4a64-ad7e-1a4c0622051c None admin] PATH_INFO: `/v3/projects/61c6294452e2469fa7d1f5438f6cefa1/users/5dab8019ad5d4abfafe3dd2c673e866f/roles/d48e46bf2b814100a25f94d5cdffecfd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:57.564496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e15451-b7a8-4a64-ad7e-1a4c0622051c None admin] RBAC: Authorizing `identity:create_grant(project_id=61c6294452e2469fa7d1f5438f6cefa1, user_id=5dab8019ad5d4abfafe3dd2c673e866f, role_id=d48e46bf2b814100a25f94d5cdffecfd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:57.565924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e15451-b7a8-4a64-ad7e-1a4c0622051c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:57.578143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 566/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:22:57 2022] PUT /identity/v3/projects/61c6294452e2469fa7d1f5438f6cefa1/users/5dab8019ad5d4abfafe3dd2c673e866f/roles/d48e46bf2b814100a25f94d5cdffecfd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:59.433519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71414a-0872-48c3-bc14-84a6515ad6d6 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:59.434073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71414a-0872-48c3-bc14-84a6515ad6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:59.434073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71414a-0872-48c3-bc14-84a6515ad6d6 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:59.436061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 558/1124] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:22:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:22:59.441321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ddb74-ec62-4bb7-a708-596c3aa9cb47 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:59.441732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ddb74-ec62-4bb7-a708-596c3aa9cb47 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:59.441873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ddb74-ec62-4bb7-a708-596c3aa9cb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:59.459583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-296ddb74-ec62-4bb7-a708-596c3aa9cb47 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:59.460755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-296ddb74-ec62-4bb7-a708-596c3aa9cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:59.514936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:59.527077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 567/1125] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:22:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:22:59.793655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71414a-0872-48c3-bc14-84a6515ad6d6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:59.891559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71414a-0872-48c3-bc14-84a6515ad6d6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:59.923931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e10bf-b5a3-47e4-ab15-30f7ab446d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:59.924537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e10bf-b5a3-47e4-ab15-30f7ab446d4d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:59.924815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e10bf-b5a3-47e4-ab15-30f7ab446d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:59.925085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e10bf-b5a3-47e4-ab15-30f7ab446d4d None admin] PATH_INFO: `/v3/roles/d48e46bf2b814100a25f94d5cdffecfd` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:59.926451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e10bf-b5a3-47e4-ab15-30f7ab446d4d None admin] RBAC: Authorizing `identity:get_role(role_id=d48e46bf2b814100a25f94d5cdffecfd)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:59.927846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e10bf-b5a3-47e4-ab15-30f7ab446d4d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:59.929136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 559/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:22:59 2022] GET /identity/v3/roles/d48e46bf2b814100a25f94d5cdffecfd => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:59.934874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ddb74-ec62-4bb7-a708-596c3aa9cb47 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:00.029958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ddb74-ec62-4bb7-a708-596c3aa9cb47 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:00.061852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4d9b-6313-467a-a398-c033044a6c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:00.062407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4d9b-6313-467a-a398-c033044a6c1e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:00.062712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4d9b-6313-467a-a398-c033044a6c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:00.062978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4d9b-6313-467a-a398-c033044a6c1e None admin] PATH_INFO: `/v3/users/5dab8019ad5d4abfafe3dd2c673e866f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:00.064077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db4d9b-6313-467a-a398-c033044a6c1e None admin] RBAC: Authorizing `identity:get_user(user_id=5dab8019ad5d4abfafe3dd2c673e866f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:00.065506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db4d9b-6313-467a-a398-c033044a6c1e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:00.067089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 568/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:22:59 2022] GET /identity/v3/users/5dab8019ad5d4abfafe3dd2c673e866f => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:00.072614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e10bf-b5a3-47e4-ab15-30f7ab446d4d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:00.126741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:00.170357 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e10bf-b5a3-47e4-ab15-30f7ab446d4d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:00.203439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe65e14-1f6c-479a-97e0-d8bea95dfe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:00.204036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe65e14-1f6c-479a-97e0-d8bea95dfe46 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:00.204314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe65e14-1f6c-479a-97e0-d8bea95dfe46 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:00.204584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe65e14-1f6c-479a-97e0-d8bea95dfe46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:00.269648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe65e14-1f6c-479a-97e0-d8bea95dfe46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:00.271097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe65e14-1f6c-479a-97e0-d8bea95dfe46 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:00.321817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:00.366329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 560/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:23:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:23:00.372236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4d9b-6313-467a-a398-c033044a6c1e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:00.428328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:00.468144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4d9b-6313-467a-a398-c033044a6c1e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:00.501095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ad59-13da-42d7-9946-5c6ccb901070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:00.501706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ad59-13da-42d7-9946-5c6ccb901070 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:00.501982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ad59-13da-42d7-9946-5c6ccb901070 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:00.502248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ad59-13da-42d7-9946-5c6ccb901070 None admin] PATH_INFO: `/v3/projects/61c6294452e2469fa7d1f5438f6cefa1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:00.503316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ad59-13da-42d7-9946-5c6ccb901070 None admin] RBAC: Authorizing `identity:get_project(project_id=61c6294452e2469fa7d1f5438f6cefa1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:00.504736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ad59-13da-42d7-9946-5c6ccb901070 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:00.506335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 569/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:23:00 2022] GET /identity/v3/projects/61c6294452e2469fa7d1f5438f6cefa1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:00.512379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe65e14-1f6c-479a-97e0-d8bea95dfe46 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:00.608612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe65e14-1f6c-479a-97e0-d8bea95dfe46 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:00.641287 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244e75b-490e-490d-b630-e240feb195c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:00.641867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e75b-490e-490d-b630-e240feb195c8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:00.642143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e75b-490e-490d-b630-e240feb195c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:00.642412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e75b-490e-490d-b630-e240feb195c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:00.643154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244e75b-490e-490d-b630-e240feb195c8 None admin] RBAC: Adding query filter params (role.id=d48e46bf2b814100a25f94d5cdffecfd, scope.project.id=61c6294452e2469fa7d1f5438f6cefa1, user.id=5dab8019ad5d4abfafe3dd2c673e866f) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:00.643460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244e75b-490e-490d-b630-e240feb195c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:00.644867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244e75b-490e-490d-b630-e240feb195c8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:00.650348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 561/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:23:00 2022] GET /identity/v3/role_assignments?user.id=5dab8019ad5d4abfafe3dd2c673e866f&scope.project.id=61c6294452e2469fa7d1f5438f6cefa1&role.id=d48e46bf2b814100a25f94d5cdffecfd => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:02.559027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688f908-1cd1-489d-bf31-6e067aa0183e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:02.559590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688f908-1cd1-489d-bf31-6e067aa0183e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:02.559590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688f908-1cd1-489d-bf31-6e067aa0183e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:02.561491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 570/1131] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:02.566570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9544944-6452-48a4-995e-bed05ed5c0e2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:02.567028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9544944-6452-48a4-995e-bed05ed5c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:02.567144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9544944-6452-48a4-995e-bed05ed5c0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:02.585251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a9544944-6452-48a4-995e-bed05ed5c0e2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:02.586410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a9544944-6452-48a4-995e-bed05ed5c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:02.599270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:02.650923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 562/1132] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:02.921372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688f908-1cd1-489d-bf31-6e067aa0183e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:03.022015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688f908-1cd1-489d-bf31-6e067aa0183e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:03.047918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:03.056397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240ffe6-bab8-43c5-9e85-dba86ae6e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:03.057018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240ffe6-bab8-43c5-9e85-dba86ae6e9cc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:03.057299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240ffe6-bab8-43c5-9e85-dba86ae6e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:03.057574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240ffe6-bab8-43c5-9e85-dba86ae6e9cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:03.058710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240ffe6-bab8-43c5-9e85-dba86ae6e9cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:03.060753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240ffe6-bab8-43c5-9e85-dba86ae6e9cc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:03.062466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 571/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:23:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:03.068258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9544944-6452-48a4-995e-bed05ed5c0e2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:03.163778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9544944-6452-48a4-995e-bed05ed5c0e2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:03.197097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03e626-dfd3-48a2-bcea-f12176df956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:03.197628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03e626-dfd3-48a2-bcea-f12176df956f None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:03.197908 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03e626-dfd3-48a2-bcea-f12176df956f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:03.198180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03e626-dfd3-48a2-bcea-f12176df956f None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:03.198847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03e626-dfd3-48a2-bcea-f12176df956f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:03.200269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03e626-dfd3-48a2-bcea-f12176df956f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:03.220854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:03.228106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 563/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:23:03 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:05.134580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de126d2-2cfa-47d1-8c43-989d94f4b12f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:05.135173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de126d2-2cfa-47d1-8c43-989d94f4b12f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:05.135173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de126d2-2cfa-47d1-8c43-989d94f4b12f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:05.136488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 572/1135] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:05.142224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0496cb-5421-444e-a856-91d9a5323d0e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:05.142676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0496cb-5421-444e-a856-91d9a5323d0e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:05.142809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0496cb-5421-444e-a856-91d9a5323d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:05.161401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3d0496cb-5421-444e-a856-91d9a5323d0e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:05.162585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3d0496cb-5421-444e-a856-91d9a5323d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:05.227766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 564/1136] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:05.494507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de126d2-2cfa-47d1-8c43-989d94f4b12f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:05.591716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de126d2-2cfa-47d1-8c43-989d94f4b12f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:05.624269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82586073-0753-400e-a800-468ff2381366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:05.624873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82586073-0753-400e-a800-468ff2381366 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:05.625149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82586073-0753-400e-a800-468ff2381366 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:05.625419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82586073-0753-400e-a800-468ff2381366 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:05.626512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82586073-0753-400e-a800-468ff2381366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:05.627968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82586073-0753-400e-a800-468ff2381366 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:05.629501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 573/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:23:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:05.635126 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0496cb-5421-444e-a856-91d9a5323d0e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:05.731571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0496cb-5421-444e-a856-91d9a5323d0e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:05.759854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:05.766701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53783591-304d-469c-b573-e44487670ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:05.767336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53783591-304d-469c-b573-e44487670ddb None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:05.767573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53783591-304d-469c-b573-e44487670ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:05.767839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53783591-304d-469c-b573-e44487670ddb None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:05.768487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53783591-304d-469c-b573-e44487670ddb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:05.769928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53783591-304d-469c-b573-e44487670ddb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:05.790172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 565/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:23:05 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:07.716051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fde61-f9f9-41bb-aecc-11153acd9214 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:07.716598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fde61-f9f9-41bb-aecc-11153acd9214 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:07.716685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fde61-f9f9-41bb-aecc-11153acd9214 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:07.718522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 574/1139] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:07.723964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019991b-e4f3-4745-9def-6f8f1818f2d6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:07.724410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019991b-e4f3-4745-9def-6f8f1818f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:07.724510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019991b-e4f3-4745-9def-6f8f1818f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:07.742260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f019991b-e4f3-4745-9def-6f8f1818f2d6 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:07.743458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f019991b-e4f3-4745-9def-6f8f1818f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:07.807419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 566/1140] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:08.080199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fde61-f9f9-41bb-aecc-11153acd9214 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:08.141417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:08.179952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fde61-f9f9-41bb-aecc-11153acd9214 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:08.213288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1916-1b9d-4656-ba6d-884a3d7faea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:08.213906 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1916-1b9d-4656-ba6d-884a3d7faea8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:08.214187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1916-1b9d-4656-ba6d-884a3d7faea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:08.214462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1916-1b9d-4656-ba6d-884a3d7faea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:08.224709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df1916-1b9d-4656-ba6d-884a3d7faea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c6df1916-1b9d-4656-ba6d-884a3d7faea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:23:08.229463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:23:08.230636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:23:08.231761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 575/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:23:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:23:08.237098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019991b-e4f3-4745-9def-6f8f1818f2d6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:08.332677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019991b-e4f3-4745-9def-6f8f1818f2d6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:08.348632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:08.367453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeead76-0de3-46fd-b682-13892f44dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:08.368046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeead76-0de3-46fd-b682-13892f44dced None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:08.368321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeead76-0de3-46fd-b682-13892f44dced None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:08.368587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeead76-0de3-46fd-b682-13892f44dced None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:08.369239 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeead76-0de3-46fd-b682-13892f44dced None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:08.369540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeead76-0de3-46fd-b682-13892f44dced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:08.370938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeead76-0de3-46fd-b682-13892f44dced None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:08.379357 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 567/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:23:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:08.385208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1916-1b9d-4656-ba6d-884a3d7faea8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:08.480641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1916-1b9d-4656-ba6d-884a3d7faea8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:08.503398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:08.514988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb63363-8503-4bef-9d4c-a84022500546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:08.515596 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb63363-8503-4bef-9d4c-a84022500546 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:08.515871 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb63363-8503-4bef-9d4c-a84022500546 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:08.516139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb63363-8503-4bef-9d4c-a84022500546 None admin] PATH_INFO: `/v3/users/0d162d482a114e96b50be9d33c01b9f6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:08.528552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb63363-8503-4bef-9d4c-a84022500546 None admin] RBAC: Authorizing `identity:get_user(user_id=0d162d482a114e96b50be9d33c01b9f6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:08.530507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb63363-8503-4bef-9d4c-a84022500546 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:08.532104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 576/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:23:08 2022] GET /identity/v3/users/0d162d482a114e96b50be9d33c01b9f6 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:08.538048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeead76-0de3-46fd-b682-13892f44dced None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:08.634655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeead76-0de3-46fd-b682-13892f44dced None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:08.667256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c636c00-da26-4f55-9298-03f152b5fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:08.667854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c636c00-da26-4f55-9298-03f152b5fecc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:08.668133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c636c00-da26-4f55-9298-03f152b5fecc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:08.668404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c636c00-da26-4f55-9298-03f152b5fecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:08.713635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:08.737015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c636c00-da26-4f55-9298-03f152b5fecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:08.738437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c636c00-da26-4f55-9298-03f152b5fecc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:08.834188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 568/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:23:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:23:08.840128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb63363-8503-4bef-9d4c-a84022500546 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:08.936781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb63363-8503-4bef-9d4c-a84022500546 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:08.969775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e04bca-7ab5-40b6-86b8-c9ff713af49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:08.970383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04bca-7ab5-40b6-86b8-c9ff713af49a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:08.970662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04bca-7ab5-40b6-86b8-c9ff713af49a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:08.970961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04bca-7ab5-40b6-86b8-c9ff713af49a None admin] PATH_INFO: `/v3/projects/89e07219c6dd4daa9b0b32143d2bb95b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:08.972051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e04bca-7ab5-40b6-86b8-c9ff713af49a None admin] RBAC: Authorizing `identity:get_project(project_id=89e07219c6dd4daa9b0b32143d2bb95b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:08.973735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e04bca-7ab5-40b6-86b8-c9ff713af49a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:08.975368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 577/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:23:08 2022] GET /identity/v3/projects/89e07219c6dd4daa9b0b32143d2bb95b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:08.981452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c636c00-da26-4f55-9298-03f152b5fecc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:09.056622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:09.078419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c636c00-da26-4f55-9298-03f152b5fecc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:09.111733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cac3-fbcb-4597-ba7c-13cda0d70bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:09.112323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cac3-fbcb-4597-ba7c-13cda0d70bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:09.112601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cac3-fbcb-4597-ba7c-13cda0d70bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:09.112871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cac3-fbcb-4597-ba7c-13cda0d70bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:09.113590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cac3-fbcb-4597-ba7c-13cda0d70bb2 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=89e07219c6dd4daa9b0b32143d2bb95b, user.id=0d162d482a114e96b50be9d33c01b9f6) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:09.113895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cac3-fbcb-4597-ba7c-13cda0d70bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:09.115350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cac3-fbcb-4597-ba7c-13cda0d70bb2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:09.120513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 569/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:23:08 2022] GET /identity/v3/role_assignments?user.id=0d162d482a114e96b50be9d33c01b9f6&scope.project.id=89e07219c6dd4daa9b0b32143d2bb95b&role.id=946af2ff291349299db56e09aacb6b03 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:10.969377 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baca3ea-daaf-4474-b0aa-ae90fc972b5e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:10.969883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baca3ea-daaf-4474-b0aa-ae90fc972b5e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:10.969883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baca3ea-daaf-4474-b0aa-ae90fc972b5e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:10.971232 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 578/1147] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:10.976493 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b580c-ac2c-4326-b5fa-2a0b5ca05b4f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:10.976924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b580c-ac2c-4326-b5fa-2a0b5ca05b4f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:10.977033 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b580c-ac2c-4326-b5fa-2a0b5ca05b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:10.995449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-df0b580c-ac2c-4326-b5fa-2a0b5ca05b4f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:10.996617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-df0b580c-ac2c-4326-b5fa-2a0b5ca05b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:11.059498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 570/1148] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:11.329334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baca3ea-daaf-4474-b0aa-ae90fc972b5e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:11.378992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:11.429655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baca3ea-daaf-4474-b0aa-ae90fc972b5e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:11.464154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ac2ea-91c5-4b3d-8730-31c9089ec385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:11.464771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ac2ea-91c5-4b3d-8730-31c9089ec385 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:11.465049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ac2ea-91c5-4b3d-8730-31c9089ec385 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:11.465316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ac2ea-91c5-4b3d-8730-31c9089ec385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:11.475939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ac2ea-91c5-4b3d-8730-31c9089ec385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-733ac2ea-91c5-4b3d-8730-31c9089ec385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:23:11.480721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:23:11.481779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:23:11.483018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 579/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:23:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:23:11.488267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b580c-ac2c-4326-b5fa-2a0b5ca05b4f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:11.562775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:11.591499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b580c-ac2c-4326-b5fa-2a0b5ca05b4f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:11.624462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cbb9a-b31d-4559-ac46-cf5070774099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:11.625047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cbb9a-b31d-4559-ac46-cf5070774099 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:11.625324 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cbb9a-b31d-4559-ac46-cf5070774099 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:11.625592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cbb9a-b31d-4559-ac46-cf5070774099 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:11.626286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cbb9a-b31d-4559-ac46-cf5070774099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:11.626584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cbb9a-b31d-4559-ac46-cf5070774099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:11.627969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cbb9a-b31d-4559-ac46-cf5070774099 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:11.635657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 571/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:23:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:11.641930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ac2ea-91c5-4b3d-8730-31c9089ec385 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:11.738735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ac2ea-91c5-4b3d-8730-31c9089ec385 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:11.747149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:11.772431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91939ad2-a301-4d09-97a6-ffe590923ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:11.773049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939ad2-a301-4d09-97a6-ffe590923ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:11.773328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939ad2-a301-4d09-97a6-ffe590923ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:11.773601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939ad2-a301-4d09-97a6-ffe590923ea2 None admin] PATH_INFO: `/v3/users/0d162d482a114e96b50be9d33c01b9f6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:11.774728 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91939ad2-a301-4d09-97a6-ffe590923ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=0d162d482a114e96b50be9d33c01b9f6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:11.776163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91939ad2-a301-4d09-97a6-ffe590923ea2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:11.777738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 580/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:23:11 2022] GET /identity/v3/users/0d162d482a114e96b50be9d33c01b9f6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:11.783571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cbb9a-b31d-4559-ac46-cf5070774099 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:11.880242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cbb9a-b31d-4559-ac46-cf5070774099 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:11.912807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9454062-3306-4f60-90cf-7a5812607a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:11.913418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9454062-3306-4f60-90cf-7a5812607a76 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:11.913700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9454062-3306-4f60-90cf-7a5812607a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:11.913977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9454062-3306-4f60-90cf-7a5812607a76 None admin] PATH_INFO: `/v3/projects/89e07219c6dd4daa9b0b32143d2bb95b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:11.915116 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9454062-3306-4f60-90cf-7a5812607a76 None admin] RBAC: Authorizing `identity:get_project(project_id=89e07219c6dd4daa9b0b32143d2bb95b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:11.916537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9454062-3306-4f60-90cf-7a5812607a76 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:11.918141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 572/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:23:11 2022] GET /identity/v3/projects/89e07219c6dd4daa9b0b32143d2bb95b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:11.924761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91939ad2-a301-4d09-97a6-ffe590923ea2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:12.021687 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91939ad2-a301-4d09-97a6-ffe590923ea2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:12.054202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45afc8-c44e-4368-923a-e7271bcc8109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:12.054864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45afc8-c44e-4368-923a-e7271bcc8109 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:12.055146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45afc8-c44e-4368-923a-e7271bcc8109 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:12.055415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45afc8-c44e-4368-923a-e7271bcc8109 None admin] PATH_INFO: `/v3/projects/89e07219c6dd4daa9b0b32143d2bb95b/users/0d162d482a114e96b50be9d33c01b9f6/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:12.057305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45afc8-c44e-4368-923a-e7271bcc8109 None admin] RBAC: Authorizing `identity:create_grant(project_id=89e07219c6dd4daa9b0b32143d2bb95b, user_id=0d162d482a114e96b50be9d33c01b9f6, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:12.058755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45afc8-c44e-4368-923a-e7271bcc8109 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:12.071989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 581/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:23:11 2022] PUT /identity/v3/projects/89e07219c6dd4daa9b0b32143d2bb95b/users/0d162d482a114e96b50be9d33c01b9f6/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:13.951251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba82781-7497-4081-9ed3-c3e133f8d360 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:13.951759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba82781-7497-4081-9ed3-c3e133f8d360 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:13.952003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba82781-7497-4081-9ed3-c3e133f8d360 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:13.953340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 573/1154] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:13.958387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e263ee2-8fa7-4138-af61-ddb8fc918403 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:13.958839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e263ee2-8fa7-4138-af61-ddb8fc918403 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:13.958952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e263ee2-8fa7-4138-af61-ddb8fc918403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:13.976968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8e263ee2-8fa7-4138-af61-ddb8fc918403 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:13.978129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e263ee2-8fa7-4138-af61-ddb8fc918403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:14.006264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:14.044095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 582/1155] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:14.309243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba82781-7497-4081-9ed3-c3e133f8d360 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.313059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:14.409208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba82781-7497-4081-9ed3-c3e133f8d360 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.442176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a140c2-5805-4f76-86a2-f55e3deb764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.442815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a140c2-5805-4f76-86a2-f55e3deb764b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.443090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a140c2-5805-4f76-86a2-f55e3deb764b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.443354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a140c2-5805-4f76-86a2-f55e3deb764b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.452999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a140c2-5805-4f76-86a2-f55e3deb764b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-67a140c2-5805-4f76-86a2-f55e3deb764b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:23:14.457618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:23:14.458746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:23:14.459848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 574/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:23:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:23:14.464647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e263ee2-8fa7-4138-af61-ddb8fc918403 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.559868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e263ee2-8fa7-4138-af61-ddb8fc918403 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.591630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9c8b9-df5f-47fb-aad9-77ff39197b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.592739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9c8b9-df5f-47fb-aad9-77ff39197b99 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.593011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9c8b9-df5f-47fb-aad9-77ff39197b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.593276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9c8b9-df5f-47fb-aad9-77ff39197b99 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.593926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9c8b9-df5f-47fb-aad9-77ff39197b99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:14.594222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9c8b9-df5f-47fb-aad9-77ff39197b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.595618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9c8b9-df5f-47fb-aad9-77ff39197b99 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.603552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 583/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:23:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:14.610272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a140c2-5805-4f76-86a2-f55e3deb764b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.674193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:14.712933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a140c2-5805-4f76-86a2-f55e3deb764b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.746383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49103afb-fd28-4897-a447-e297aa6e6b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.747025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49103afb-fd28-4897-a447-e297aa6e6b8a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.747302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49103afb-fd28-4897-a447-e297aa6e6b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.747569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49103afb-fd28-4897-a447-e297aa6e6b8a None admin] PATH_INFO: `/v3/users/0d162d482a114e96b50be9d33c01b9f6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.749079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49103afb-fd28-4897-a447-e297aa6e6b8a None admin] RBAC: Authorizing `identity:get_user(user_id=0d162d482a114e96b50be9d33c01b9f6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.750496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49103afb-fd28-4897-a447-e297aa6e6b8a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.752090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 575/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:23:14 2022] GET /identity/v3/users/0d162d482a114e96b50be9d33c01b9f6 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:14.758100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9c8b9-df5f-47fb-aad9-77ff39197b99 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.786795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:14.856481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9c8b9-df5f-47fb-aad9-77ff39197b99 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.890735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36849d5-be9d-428f-a263-9a86eb595e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.891336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36849d5-be9d-428f-a263-9a86eb595e6c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.891618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36849d5-be9d-428f-a263-9a86eb595e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.891892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36849d5-be9d-428f-a263-9a86eb595e6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.956310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36849d5-be9d-428f-a263-9a86eb595e6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.957759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36849d5-be9d-428f-a263-9a86eb595e6c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.984997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:15.054458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 584/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:23:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:23:15.060472 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49103afb-fd28-4897-a447-e297aa6e6b8a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:15.158713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49103afb-fd28-4897-a447-e297aa6e6b8a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:15.186432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:15.192410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817fb82-f50e-4bfd-8759-5b8a51f28eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:15.193027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817fb82-f50e-4bfd-8759-5b8a51f28eee None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:15.193306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817fb82-f50e-4bfd-8759-5b8a51f28eee None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:15.193576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817fb82-f50e-4bfd-8759-5b8a51f28eee None admin] PATH_INFO: `/v3/projects/89e07219c6dd4daa9b0b32143d2bb95b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:15.194694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817fb82-f50e-4bfd-8759-5b8a51f28eee None admin] RBAC: Authorizing `identity:get_project(project_id=89e07219c6dd4daa9b0b32143d2bb95b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:15.196134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817fb82-f50e-4bfd-8759-5b8a51f28eee None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:15.197741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 576/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:23:15 2022] GET /identity/v3/projects/89e07219c6dd4daa9b0b32143d2bb95b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:15.204325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36849d5-be9d-428f-a263-9a86eb595e6c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:15.299915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36849d5-be9d-428f-a263-9a86eb595e6c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:15.325455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:15.333876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605a639-798e-48d2-8610-3d38eaf76cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:15.334466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605a639-798e-48d2-8610-3d38eaf76cfc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:15.334775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605a639-798e-48d2-8610-3d38eaf76cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:15.335046 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605a639-798e-48d2-8610-3d38eaf76cfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:15.335759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605a639-798e-48d2-8610-3d38eaf76cfc None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=89e07219c6dd4daa9b0b32143d2bb95b, user.id=0d162d482a114e96b50be9d33c01b9f6) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:15.336061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605a639-798e-48d2-8610-3d38eaf76cfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:15.337487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605a639-798e-48d2-8610-3d38eaf76cfc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:15.343098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 585/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:23:15 2022] GET /identity/v3/role_assignments?user.id=0d162d482a114e96b50be9d33c01b9f6&scope.project.id=89e07219c6dd4daa9b0b32143d2bb95b&role.id=946af2ff291349299db56e09aacb6b03 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:17.259048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f69fa-b0eb-48c2-a061-99c21e95963a None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:17.259588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f69fa-b0eb-48c2-a061-99c21e95963a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:17.259588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f69fa-b0eb-48c2-a061-99c21e95963a None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:17.260916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 577/1162] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:17.266552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d122407-4874-4264-b7e3-4f44ac11c247 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:17.267026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d122407-4874-4264-b7e3-4f44ac11c247 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:17.267121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d122407-4874-4264-b7e3-4f44ac11c247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:17.285855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9d122407-4874-4264-b7e3-4f44ac11c247 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:17.287052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9d122407-4874-4264-b7e3-4f44ac11c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:17.352456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 586/1163] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:17.619121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f69fa-b0eb-48c2-a061-99c21e95963a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:17.719373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f69fa-b0eb-48c2-a061-99c21e95963a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:17.752521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b62b3-ca21-43f6-b4f3-3977372a67b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:17.753117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b62b3-ca21-43f6-b4f3-3977372a67b4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:17.753401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b62b3-ca21-43f6-b4f3-3977372a67b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:17.753671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b62b3-ca21-43f6-b4f3-3977372a67b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:17.815846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:17.819590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b62b3-ca21-43f6-b4f3-3977372a67b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:17.821023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b62b3-ca21-43f6-b4f3-3977372a67b4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:17.915115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 578/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:23:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:23:17.921710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d122407-4874-4264-b7e3-4f44ac11c247 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:18.018997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d122407-4874-4264-b7e3-4f44ac11c247 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:18.040657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:18.052758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c6aee-7d01-4813-ba27-f1d6b4f97e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:18.053381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6aee-7d01-4813-ba27-f1d6b4f97e1b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:18.053659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6aee-7d01-4813-ba27-f1d6b4f97e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:18.053931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6aee-7d01-4813-ba27-f1d6b4f97e1b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:18.060409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c6aee-7d01-4813-ba27-f1d6b4f97e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:18.062420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c6aee-7d01-4813-ba27-f1d6b4f97e1b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-237c6aee-7d01-4813-ba27-f1d6b4f97e1b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:23:18.073528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:23:18.074563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:23:18.075756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 587/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:23:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:23:18.080705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b62b3-ca21-43f6-b4f3-3977372a67b4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:18.171191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:18.175081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b62b3-ca21-43f6-b4f3-3977372a67b4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:18.207287 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898d1f8-336a-4858-bd5e-d663cde554b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:18.207872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898d1f8-336a-4858-bd5e-d663cde554b6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:18.208143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898d1f8-336a-4858-bd5e-d663cde554b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:18.208406 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898d1f8-336a-4858-bd5e-d663cde554b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:18.209029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898d1f8-336a-4858-bd5e-d663cde554b6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:18.209322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898d1f8-336a-4858-bd5e-d663cde554b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:18.210668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898d1f8-336a-4858-bd5e-d663cde554b6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:18.217465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 579/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 31 11:23:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:20.098999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba49f-7613-488a-abfb-216887ebb878 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:20.099553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba49f-7613-488a-abfb-216887ebb878 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:20.099553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba49f-7613-488a-abfb-216887ebb878 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:20.100873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 588/1167] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:20.105917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89e5a-d8ce-41a8-8597-bf6f464e5449 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:20.106343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89e5a-d8ce-41a8-8597-bf6f464e5449 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:20.106466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89e5a-d8ce-41a8-8597-bf6f464e5449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:20.124973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-60c89e5a-d8ce-41a8-8597-bf6f464e5449 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:20.126149 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-60c89e5a-d8ce-41a8-8597-bf6f464e5449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:20.190995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 580/1168] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:20.463004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ba49f-7613-488a-abfb-216887ebb878 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:20.563002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ba49f-7613-488a-abfb-216887ebb878 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:20.595476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a477-29f3-4b42-aea1-c06986af46c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:20.596063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a477-29f3-4b42-aea1-c06986af46c9 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:20.596340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a477-29f3-4b42-aea1-c06986af46c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:20.596608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a477-29f3-4b42-aea1-c06986af46c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:20.597256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a477-29f3-4b42-aea1-c06986af46c9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:20.598627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a477-29f3-4b42-aea1-c06986af46c9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:20.614931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 589/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Wed Aug 31 11:23:20 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:22.612347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac404-93db-4759-8ff9-49998b8deced None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:22.612893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac404-93db-4759-8ff9-49998b8deced None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:22.612893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac404-93db-4759-8ff9-49998b8deced None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:22.614195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 581/1170] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:22.619505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fce96-c5dd-479b-a26a-bd6d57aed9a9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:22.619929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fce96-c5dd-479b-a26a-bd6d57aed9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:22.620043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fce96-c5dd-479b-a26a-bd6d57aed9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:22.641401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1f8fce96-c5dd-479b-a26a-bd6d57aed9a9 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:22.642582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1f8fce96-c5dd-479b-a26a-bd6d57aed9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:22.684072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:22.721917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 590/1171] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:22.991861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac404-93db-4759-8ff9-49998b8deced None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:23.083663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:23.094467 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac404-93db-4759-8ff9-49998b8deced None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:23.128993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fcda0-bc8d-4beb-af3e-33034f372bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:23.129603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fcda0-bc8d-4beb-af3e-33034f372bfd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:23.129874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fcda0-bc8d-4beb-af3e-33034f372bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:23.130146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fcda0-bc8d-4beb-af3e-33034f372bfd None admin] PATH_INFO: `/v3/domains/c59cbd4baffe4453a4a7d6d141df3dee` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:23.141053 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fcda0-bc8d-4beb-af3e-33034f372bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=c59cbd4baffe4453a4a7d6d141df3dee)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:23.142507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fcda0-bc8d-4beb-af3e-33034f372bfd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:23.144100 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 582/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Aug 31 11:23:22 2022] GET /identity/v3/domains/c59cbd4baffe4453a4a7d6d141df3dee => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:23.149916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fce96-c5dd-479b-a26a-bd6d57aed9a9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:23.247196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fce96-c5dd-479b-a26a-bd6d57aed9a9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:23.280548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fc73a-d61a-40ab-96c5-03fc7a5d582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:23.281143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fc73a-d61a-40ab-96c5-03fc7a5d582e None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:23.281422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fc73a-d61a-40ab-96c5-03fc7a5d582e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:23.281693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fc73a-d61a-40ab-96c5-03fc7a5d582e None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:23.282344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fc73a-d61a-40ab-96c5-03fc7a5d582e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:23.283801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fc73a-d61a-40ab-96c5-03fc7a5d582e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:23.309658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 591/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:23:23 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:23:25.236878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9273bf7-c203-4e1f-bd30-f8fc775abca4 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:25.237414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9273bf7-c203-4e1f-bd30-f8fc775abca4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:25.237414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9273bf7-c203-4e1f-bd30-f8fc775abca4 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:25.238762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 583/1174] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:25.243931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea61025-e269-4483-abe7-1125050ef1b0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:25.244364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea61025-e269-4483-abe7-1125050ef1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:25.244483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea61025-e269-4483-abe7-1125050ef1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:25.262345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0ea61025-e269-4483-abe7-1125050ef1b0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:25.263598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0ea61025-e269-4483-abe7-1125050ef1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:25.280695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:25.330307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 592/1175] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:25.603635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9273bf7-c203-4e1f-bd30-f8fc775abca4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:25.702856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9273bf7-c203-4e1f-bd30-f8fc775abca4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:25.735832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688551d1-fb12-43a8-9dfb-b11a59d835e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:25.736442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688551d1-fb12-43a8-9dfb-b11a59d835e6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:25.736714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688551d1-fb12-43a8-9dfb-b11a59d835e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:25.736978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688551d1-fb12-43a8-9dfb-b11a59d835e6 None admin] PATH_INFO: `/v3/domains/c59cbd4baffe4453a4a7d6d141df3dee` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:25.738059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688551d1-fb12-43a8-9dfb-b11a59d835e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c59cbd4baffe4453a4a7d6d141df3dee)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:25.739488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688551d1-fb12-43a8-9dfb-b11a59d835e6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:25.741023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 584/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Aug 31 11:23:25 2022] GET /identity/v3/domains/c59cbd4baffe4453a4a7d6d141df3dee => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:25.746843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea61025-e269-4483-abe7-1125050ef1b0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:25.841343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea61025-e269-4483-abe7-1125050ef1b0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:25.874941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29f312-2e82-46ba-bc8c-2051e2c066a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:25.875474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29f312-2e82-46ba-bc8c-2051e2c066a1 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:25.875750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29f312-2e82-46ba-bc8c-2051e2c066a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:25.876017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29f312-2e82-46ba-bc8c-2051e2c066a1 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:25.876665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29f312-2e82-46ba-bc8c-2051e2c066a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:25.878091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29f312-2e82-46ba-bc8c-2051e2c066a1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:25.899434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 593/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:23:25 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:23:27.857142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412be7b-564c-45b0-aad4-1321e181b218 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:27.858166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412be7b-564c-45b0-aad4-1321e181b218 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:27.858166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412be7b-564c-45b0-aad4-1321e181b218 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:27.859601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 585/1178] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:27.864818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0c9d3-e280-445c-8c60-4e29e1f1dd19 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:27.865236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0c9d3-e280-445c-8c60-4e29e1f1dd19 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:27.865366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0c9d3-e280-445c-8c60-4e29e1f1dd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:27.883989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-12e0c9d3-e280-445c-8c60-4e29e1f1dd19 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:27.885158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12e0c9d3-e280-445c-8c60-4e29e1f1dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:27.887867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:27.949533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 594/1179] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:28.216766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412be7b-564c-45b0-aad4-1321e181b218 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:28.238515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:28.316972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412be7b-564c-45b0-aad4-1321e181b218 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:28.349709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485c13f-905f-4525-8f56-498494891b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:28.350319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c13f-905f-4525-8f56-498494891b0b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:28.350593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c13f-905f-4525-8f56-498494891b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:28.350889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c13f-905f-4525-8f56-498494891b0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:28.361571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485c13f-905f-4525-8f56-498494891b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4485c13f-905f-4525-8f56-498494891b0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:23:28.366268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:23:28.367474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:23:28.368723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 586/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:23:28.373505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0c9d3-e280-445c-8c60-4e29e1f1dd19 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:28.469439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0c9d3-e280-445c-8c60-4e29e1f1dd19 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:28.501446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493854e3-8721-469d-9abb-8b7713b14079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:28.502033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493854e3-8721-469d-9abb-8b7713b14079 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:28.502308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493854e3-8721-469d-9abb-8b7713b14079 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:28.502578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493854e3-8721-469d-9abb-8b7713b14079 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:28.503265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493854e3-8721-469d-9abb-8b7713b14079 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:28.503563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493854e3-8721-469d-9abb-8b7713b14079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:28.504929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493854e3-8721-469d-9abb-8b7713b14079 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:28.512667 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 595/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:28.519062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485c13f-905f-4525-8f56-498494891b0b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:28.597725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:28.616383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485c13f-905f-4525-8f56-498494891b0b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:28.648957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31275220-76c9-4d0c-9cbc-bf016352895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:28.649568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31275220-76c9-4d0c-9cbc-bf016352895a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:28.649845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31275220-76c9-4d0c-9cbc-bf016352895a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:28.650116 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31275220-76c9-4d0c-9cbc-bf016352895a None admin] PATH_INFO: `/v3/users/dc0b22afb5fc422a9267a2cd48149e22` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:28.663487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31275220-76c9-4d0c-9cbc-bf016352895a None admin] RBAC: Authorizing `identity:get_user(user_id=dc0b22afb5fc422a9267a2cd48149e22)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:28.664923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31275220-76c9-4d0c-9cbc-bf016352895a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:28.666545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 587/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:23:28 2022] GET /identity/v3/users/dc0b22afb5fc422a9267a2cd48149e22 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:28.672375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493854e3-8721-469d-9abb-8b7713b14079 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:28.675258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:28.770353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493854e3-8721-469d-9abb-8b7713b14079 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:28.803262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295cd5a-3691-42c3-af87-de3da090631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:28.803863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295cd5a-3691-42c3-af87-de3da090631a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:28.804141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295cd5a-3691-42c3-af87-de3da090631a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:28.804412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295cd5a-3691-42c3-af87-de3da090631a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:28.870297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295cd5a-3691-42c3-af87-de3da090631a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:28.871796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295cd5a-3691-42c3-af87-de3da090631a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:28.873719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:28.974964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 596/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:23:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:23:28.980891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31275220-76c9-4d0c-9cbc-bf016352895a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:29.077988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31275220-76c9-4d0c-9cbc-bf016352895a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:29.111352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc6c30-92ff-47ac-ac02-ead141bb217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:29.111969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc6c30-92ff-47ac-ac02-ead141bb217f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.112250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc6c30-92ff-47ac-ac02-ead141bb217f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.112525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc6c30-92ff-47ac-ac02-ead141bb217f None admin] PATH_INFO: `/v3/projects/a1b0feab578b4684bcd60a6f25a434ad` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.113628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc6c30-92ff-47ac-ac02-ead141bb217f None admin] RBAC: Authorizing `identity:get_project(project_id=a1b0feab578b4684bcd60a6f25a434ad)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:29.115087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc6c30-92ff-47ac-ac02-ead141bb217f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:29.116706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 588/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:23:28 2022] GET /identity/v3/projects/a1b0feab578b4684bcd60a6f25a434ad => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:29.123045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295cd5a-3691-42c3-af87-de3da090631a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:29.220028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295cd5a-3691-42c3-af87-de3da090631a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:29.221508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:29.254198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9734b-3477-4491-aba7-c9cb4748cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:29.254854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9734b-3477-4491-aba7-c9cb4748cf8e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.255133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9734b-3477-4491-aba7-c9cb4748cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.255404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9734b-3477-4491-aba7-c9cb4748cf8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.256122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9734b-3477-4491-aba7-c9cb4748cf8e None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=a1b0feab578b4684bcd60a6f25a434ad, user.id=dc0b22afb5fc422a9267a2cd48149e22) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:29.256428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9734b-3477-4491-aba7-c9cb4748cf8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:29.257856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9734b-3477-4491-aba7-c9cb4748cf8e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:29.263076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 597/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:23:29 2022] GET /identity/v3/role_assignments?user.id=dc0b22afb5fc422a9267a2cd48149e22&scope.project.id=a1b0feab578b4684bcd60a6f25a434ad&role.id=946af2ff291349299db56e09aacb6b03 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:31.141789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f678d39-e550-4d0a-8069-039ceb4aca97 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.142349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f678d39-e550-4d0a-8069-039ceb4aca97 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.142349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f678d39-e550-4d0a-8069-039ceb4aca97 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.143695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 589/1186] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:31.149026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963acfd-56c2-406e-a33c-180a04f73d07 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.149420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963acfd-56c2-406e-a33c-180a04f73d07 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.149572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963acfd-56c2-406e-a33c-180a04f73d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.167571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8963acfd-56c2-406e-a33c-180a04f73d07 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:31.168736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8963acfd-56c2-406e-a33c-180a04f73d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:31.234047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 598/1187] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:31.506985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f678d39-e550-4d0a-8069-039ceb4aca97 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:31.516462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:31.608335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f678d39-e550-4d0a-8069-039ceb4aca97 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:31.640996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc5cb2-7595-4d80-bdef-086c537fc629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:31.641608 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5cb2-7595-4d80-bdef-086c537fc629 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.641885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5cb2-7595-4d80-bdef-086c537fc629 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.642156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5cb2-7595-4d80-bdef-086c537fc629 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.651915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc5cb2-7595-4d80-bdef-086c537fc629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-41dc5cb2-7595-4d80-bdef-086c537fc629 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:23:31.657206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:23:31.658348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:23:31.659412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 590/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:23:31.664405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963acfd-56c2-406e-a33c-180a04f73d07 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:31.755969 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:31.761998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963acfd-56c2-406e-a33c-180a04f73d07 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:31.799368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551d578-c00b-40e7-9c88-594a1541b284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:31.799967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551d578-c00b-40e7-9c88-594a1541b284 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.800246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551d578-c00b-40e7-9c88-594a1541b284 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.800517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551d578-c00b-40e7-9c88-594a1541b284 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.801176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551d578-c00b-40e7-9c88-594a1541b284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:31.801479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551d578-c00b-40e7-9c88-594a1541b284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:31.802874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551d578-c00b-40e7-9c88-594a1541b284 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:31.810660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 599/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:23:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:31.816751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc5cb2-7595-4d80-bdef-086c537fc629 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:31.880930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:31.915380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc5cb2-7595-4d80-bdef-086c537fc629 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:31.948394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977ae23-636e-45d7-9d6c-a9fa2a914808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:31.949007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977ae23-636e-45d7-9d6c-a9fa2a914808 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.949285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977ae23-636e-45d7-9d6c-a9fa2a914808 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.949556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977ae23-636e-45d7-9d6c-a9fa2a914808 None admin] PATH_INFO: `/v3/users/dc0b22afb5fc422a9267a2cd48149e22` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.950662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977ae23-636e-45d7-9d6c-a9fa2a914808 None admin] RBAC: Authorizing `identity:get_user(user_id=dc0b22afb5fc422a9267a2cd48149e22)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:31.952186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977ae23-636e-45d7-9d6c-a9fa2a914808 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:31.953738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 591/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:23:31 2022] GET /identity/v3/users/dc0b22afb5fc422a9267a2cd48149e22 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:23:31.959552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551d578-c00b-40e7-9c88-594a1541b284 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:32.057704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551d578-c00b-40e7-9c88-594a1541b284 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:32.089893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd52f0-6fdd-4c69-ac5d-f645ce44a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:32.090506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd52f0-6fdd-4c69-ac5d-f645ce44a905 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:32.090829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd52f0-6fdd-4c69-ac5d-f645ce44a905 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:32.091092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd52f0-6fdd-4c69-ac5d-f645ce44a905 None admin] PATH_INFO: `/v3/projects/a1b0feab578b4684bcd60a6f25a434ad` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:32.092727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd52f0-6fdd-4c69-ac5d-f645ce44a905 None admin] RBAC: Authorizing `identity:get_project(project_id=a1b0feab578b4684bcd60a6f25a434ad)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:32.094159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd52f0-6fdd-4c69-ac5d-f645ce44a905 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:32.095796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 600/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:23:31 2022] GET /identity/v3/projects/a1b0feab578b4684bcd60a6f25a434ad => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:32.101891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977ae23-636e-45d7-9d6c-a9fa2a914808 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:32.197448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977ae23-636e-45d7-9d6c-a9fa2a914808 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:32.230775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214c8e8-4868-4783-a5e7-863368aca608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:32.231419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c8e8-4868-4783-a5e7-863368aca608 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:32.231698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c8e8-4868-4783-a5e7-863368aca608 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:32.231971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c8e8-4868-4783-a5e7-863368aca608 None admin] PATH_INFO: `/v3/projects/a1b0feab578b4684bcd60a6f25a434ad/users/dc0b22afb5fc422a9267a2cd48149e22/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:32.234036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c8e8-4868-4783-a5e7-863368aca608 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1b0feab578b4684bcd60a6f25a434ad, user_id=dc0b22afb5fc422a9267a2cd48149e22, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:32.235505 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c8e8-4868-4783-a5e7-863368aca608 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:32.237685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:32.248170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 592/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:23:32 2022] PUT /identity/v3/projects/a1b0feab578b4684bcd60a6f25a434ad/users/dc0b22afb5fc422a9267a2cd48149e22/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:34.125840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063a6d-4972-4366-8216-136420102a71 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:34.126369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063a6d-4972-4366-8216-136420102a71 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:34.126369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063a6d-4972-4366-8216-136420102a71 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:34.127782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 601/1193] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:34.132967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331145fa-3be5-4e47-8eab-4a06dc83740a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:34.133348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331145fa-3be5-4e47-8eab-4a06dc83740a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:34.133510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331145fa-3be5-4e47-8eab-4a06dc83740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:34.151799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-331145fa-3be5-4e47-8eab-4a06dc83740a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:34.152968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-331145fa-3be5-4e47-8eab-4a06dc83740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:34.216936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 593/1194] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:23:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:23:34.481894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52063a6d-4972-4366-8216-136420102a71 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:34.510771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:34.583053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52063a6d-4972-4366-8216-136420102a71 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:34.615695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae91c9a-d434-43a2-8168-28677223b66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:34.616314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae91c9a-d434-43a2-8168-28677223b66f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:34.616593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae91c9a-d434-43a2-8168-28677223b66f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:34.616867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae91c9a-d434-43a2-8168-28677223b66f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:34.627222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae91c9a-d434-43a2-8168-28677223b66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3ae91c9a-d434-43a2-8168-28677223b66f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:23:34.631995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:23:34.633107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:23:34.633950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 602/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:23:34.639973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331145fa-3be5-4e47-8eab-4a06dc83740a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:34.736588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331145fa-3be5-4e47-8eab-4a06dc83740a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:34.759207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:34.770846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43508d9-f3be-4f25-8371-4d7d4e059c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:34.771446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43508d9-f3be-4f25-8371-4d7d4e059c4a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:34.771727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43508d9-f3be-4f25-8371-4d7d4e059c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:34.771998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43508d9-f3be-4f25-8371-4d7d4e059c4a None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:34.772656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43508d9-f3be-4f25-8371-4d7d4e059c4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:34.772964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43508d9-f3be-4f25-8371-4d7d4e059c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:34.774334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43508d9-f3be-4f25-8371-4d7d4e059c4a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:34.782264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 594/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:34.787987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae91c9a-d434-43a2-8168-28677223b66f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:34.870550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:34.885564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae91c9a-d434-43a2-8168-28677223b66f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:34.925851 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45b2a-c267-4a49-a623-5651019c251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:34.926472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45b2a-c267-4a49-a623-5651019c251f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:34.926781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45b2a-c267-4a49-a623-5651019c251f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:34.927060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45b2a-c267-4a49-a623-5651019c251f None admin] PATH_INFO: `/v3/users/dc0b22afb5fc422a9267a2cd48149e22` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:34.928176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de45b2a-c267-4a49-a623-5651019c251f None admin] RBAC: Authorizing `identity:get_user(user_id=dc0b22afb5fc422a9267a2cd48149e22)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:34.929615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de45b2a-c267-4a49-a623-5651019c251f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:34.931235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 603/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 31 11:23:34 2022] GET /identity/v3/users/dc0b22afb5fc422a9267a2cd48149e22 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:34.937399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43508d9-f3be-4f25-8371-4d7d4e059c4a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:35.034880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43508d9-f3be-4f25-8371-4d7d4e059c4a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:35.067616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cda7b8-3ed0-47cd-9179-5370d3d9490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:35.068216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cda7b8-3ed0-47cd-9179-5370d3d9490b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:35.068494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cda7b8-3ed0-47cd-9179-5370d3d9490b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:35.068766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cda7b8-3ed0-47cd-9179-5370d3d9490b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:35.121302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:35.134390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cda7b8-3ed0-47cd-9179-5370d3d9490b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:35.135860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cda7b8-3ed0-47cd-9179-5370d3d9490b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:35.230270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 595/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:23:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:23:35.236926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45b2a-c267-4a49-a623-5651019c251f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:35.333554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45b2a-c267-4a49-a623-5651019c251f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:35.367114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e88d3-75fd-4ce2-a3c4-837aa000eeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:35.367725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e88d3-75fd-4ce2-a3c4-837aa000eeea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:35.368005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e88d3-75fd-4ce2-a3c4-837aa000eeea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:35.368277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e88d3-75fd-4ce2-a3c4-837aa000eeea None admin] PATH_INFO: `/v3/projects/a1b0feab578b4684bcd60a6f25a434ad` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:35.369381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e88d3-75fd-4ce2-a3c4-837aa000eeea None admin] RBAC: Authorizing `identity:get_project(project_id=a1b0feab578b4684bcd60a6f25a434ad)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:35.370843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e88d3-75fd-4ce2-a3c4-837aa000eeea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:35.372456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 604/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 31 11:23:35 2022] GET /identity/v3/projects/a1b0feab578b4684bcd60a6f25a434ad => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:35.379144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cda7b8-3ed0-47cd-9179-5370d3d9490b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:35.460015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:35.474873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cda7b8-3ed0-47cd-9179-5370d3d9490b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:35.507894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c0603-6b96-4997-bf32-2a1de4ce5243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:35.508477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c0603-6b96-4997-bf32-2a1de4ce5243 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:35.508785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c0603-6b96-4997-bf32-2a1de4ce5243 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:35.509057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c0603-6b96-4997-bf32-2a1de4ce5243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:35.509768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c0603-6b96-4997-bf32-2a1de4ce5243 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=a1b0feab578b4684bcd60a6f25a434ad, user.id=dc0b22afb5fc422a9267a2cd48149e22) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:35.510072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c0603-6b96-4997-bf32-2a1de4ce5243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:35.511539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c0603-6b96-4997-bf32-2a1de4ce5243 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:35.517452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 596/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:23:35 2022] GET /identity/v3/role_assignments?user.id=dc0b22afb5fc422a9267a2cd48149e22&scope.project.id=a1b0feab578b4684bcd60a6f25a434ad&role.id=946af2ff291349299db56e09aacb6b03 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:45.363079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:45.514980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=25 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:30.894035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911ba1f-38fb-4ed4-88ae-36691a0b8c9c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:30.894636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911ba1f-38fb-4ed4-88ae-36691a0b8c9c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:30.894636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911ba1f-38fb-4ed4-88ae-36691a0b8c9c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:30.896247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 605/1201] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:24:30.901625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1a2d8-be20-41e4-996c-b7b50eb68c28 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:30.902107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1a2d8-be20-41e4-996c-b7b50eb68c28 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:30.902206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1a2d8-be20-41e4-996c-b7b50eb68c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:30.924193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-41a1a2d8-be20-41e4-996c-b7b50eb68c28 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:30.925689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-41a1a2d8-be20-41e4-996c-b7b50eb68c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:31.018850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 597/1202] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:24:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:24:31.318385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911ba1f-38fb-4ed4-88ae-36691a0b8c9c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:31.440881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911ba1f-38fb-4ed4-88ae-36691a0b8c9c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:31.479605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80860461-8e7e-4de6-a085-b1c85e06603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:31.480241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80860461-8e7e-4de6-a085-b1c85e06603c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:31.480519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80860461-8e7e-4de6-a085-b1c85e06603c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:31.480798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80860461-8e7e-4de6-a085-b1c85e06603c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:31.492655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80860461-8e7e-4de6-a085-b1c85e06603c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:31.494161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80860461-8e7e-4de6-a085-b1c85e06603c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-80860461-8e7e-4de6-a085-b1c85e06603c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:31.511895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:31.514170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:31.515453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:31.515453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:31.515453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:31.515453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 606/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:31.523272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1a2d8-be20-41e4-996c-b7b50eb68c28 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:31.662327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1a2d8-be20-41e4-996c-b7b50eb68c28 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:31.700081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:31.710588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d564ed-55b0-4454-9322-4ba531a1040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:31.711235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d564ed-55b0-4454-9322-4ba531a1040a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:31.711510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d564ed-55b0-4454-9322-4ba531a1040a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:31.711776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d564ed-55b0-4454-9322-4ba531a1040a None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:31.712440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d564ed-55b0-4454-9322-4ba531a1040a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:31.712746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d564ed-55b0-4454-9322-4ba531a1040a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:31.714302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d564ed-55b0-4454-9322-4ba531a1040a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:31.730745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 598/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:31.735434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80860461-8e7e-4de6-a085-b1c85e06603c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:31.797612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:31.856030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80860461-8e7e-4de6-a085-b1c85e06603c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:31.893019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75fa45-4a8d-4c11-9fd6-952914870f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:31.893634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75fa45-4a8d-4c11-9fd6-952914870f75 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:31.893905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75fa45-4a8d-4c11-9fd6-952914870f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:31.894190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75fa45-4a8d-4c11-9fd6-952914870f75 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:31.894879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75fa45-4a8d-4c11-9fd6-952914870f75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:31.896324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75fa45-4a8d-4c11-9fd6-952914870f75 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:31.919956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 607/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 31 11:24:31 2022] POST /identity/v3/users => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:24:34.055895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec6bd6-12f7-4bbc-9c8e-fbf6a933b82f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:34.056829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec6bd6-12f7-4bbc-9c8e-fbf6a933b82f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:34.056829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec6bd6-12f7-4bbc-9c8e-fbf6a933b82f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:34.058202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 599/1206] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:24:34.064247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfdcf9-b8d1-4f09-b341-d47499c63829 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:34.064940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfdcf9-b8d1-4f09-b341-d47499c63829 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:34.065179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfdcf9-b8d1-4f09-b341-d47499c63829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:34.085366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0bdfdcf9-b8d1-4f09-b341-d47499c63829 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:34.086629 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0bdfdcf9-b8d1-4f09-b341-d47499c63829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:34.165317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 608/1207] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:24:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:24:34.431967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec6bd6-12f7-4bbc-9c8e-fbf6a933b82f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:34.547441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec6bd6-12f7-4bbc-9c8e-fbf6a933b82f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:34.586137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebdbff-d4c2-45bb-9bcd-b9c52432a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:34.586787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebdbff-d4c2-45bb-9bcd-b9c52432a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:34.587063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebdbff-d4c2-45bb-9bcd-b9c52432a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:34.587325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebdbff-d4c2-45bb-9bcd-b9c52432a6d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:34.599009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebdbff-d4c2-45bb-9bcd-b9c52432a6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c5ebdbff-d4c2-45bb-9bcd-b9c52432a6d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:24:34.604168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:34.605154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:34.606037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 600/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:24:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:34.611480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfdcf9-b8d1-4f09-b341-d47499c63829 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:34.658005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:34.723263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfdcf9-b8d1-4f09-b341-d47499c63829 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:34.764058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1c02-68b0-477e-8133-398da00dc3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:34.764737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1c02-68b0-477e-8133-398da00dc3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:34.765019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1c02-68b0-477e-8133-398da00dc3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:34.765289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1c02-68b0-477e-8133-398da00dc3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:34.765989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c1c02-68b0-477e-8133-398da00dc3e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:34.766306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c1c02-68b0-477e-8133-398da00dc3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:34.767759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c1c02-68b0-477e-8133-398da00dc3e9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:34.776716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 609/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:34.783873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebdbff-d4c2-45bb-9bcd-b9c52432a6d3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:34.839986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:34.894733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebdbff-d4c2-45bb-9bcd-b9c52432a6d3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:34.931036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837aac4c-95e0-4ffa-894c-7f4debdd267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:34.932056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837aac4c-95e0-4ffa-894c-7f4debdd267f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:34.932366 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837aac4c-95e0-4ffa-894c-7f4debdd267f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:34.932732 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837aac4c-95e0-4ffa-894c-7f4debdd267f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:34.945100 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837aac4c-95e0-4ffa-894c-7f4debdd267f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:34.946904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837aac4c-95e0-4ffa-894c-7f4debdd267f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-837aac4c-95e0-4ffa-894c-7f4debdd267f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:34.965538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:34.967441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:34.968545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:34.968545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:34.968545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:34.968545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 601/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:24:34.975184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1c02-68b0-477e-8133-398da00dc3e9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:35.092838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:35.096195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1c02-68b0-477e-8133-398da00dc3e9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:35.132528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d7e3c-2378-47d3-9dac-3b2b12bd6342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:35.133307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d7e3c-2378-47d3-9dac-3b2b12bd6342 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:35.133671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d7e3c-2378-47d3-9dac-3b2b12bd6342 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:35.133930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d7e3c-2378-47d3-9dac-3b2b12bd6342 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:35.134611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d7e3c-2378-47d3-9dac-3b2b12bd6342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:35.134956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d7e3c-2378-47d3-9dac-3b2b12bd6342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:35.136423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d7e3c-2378-47d3-9dac-3b2b12bd6342 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:35.149891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 610/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:35.156763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837aac4c-95e0-4ffa-894c-7f4debdd267f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:35.276697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837aac4c-95e0-4ffa-894c-7f4debdd267f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:35.278250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:35.319277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59182c-0cc6-4c93-a041-04bad10f0ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:35.319980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59182c-0cc6-4c93-a041-04bad10f0ddd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:35.320197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59182c-0cc6-4c93-a041-04bad10f0ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:35.320462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59182c-0cc6-4c93-a041-04bad10f0ddd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:35.330016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59182c-0cc6-4c93-a041-04bad10f0ddd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:35.331658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59182c-0cc6-4c93-a041-04bad10f0ddd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-1b59182c-0cc6-4c93-a041-04bad10f0ddd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:24:35.344104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:35.345185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:35.347813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 602/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:35.351422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d7e3c-2378-47d3-9dac-3b2b12bd6342 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:35.471808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d7e3c-2378-47d3-9dac-3b2b12bd6342 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:35.510734 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7e310-5dd4-428e-9192-3773fd51cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:35.511498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e310-5dd4-428e-9192-3773fd51cff0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:35.511888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e310-5dd4-428e-9192-3773fd51cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:35.512262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e310-5dd4-428e-9192-3773fd51cff0 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:35.513170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7e310-5dd4-428e-9192-3773fd51cff0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:35.514417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7e310-5dd4-428e-9192-3773fd51cff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:35.515906 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7e310-5dd4-428e-9192-3773fd51cff0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:35.534864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 611/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 31 11:24:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:35.541454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59182c-0cc6-4c93-a041-04bad10f0ddd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:35.660172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59182c-0cc6-4c93-a041-04bad10f0ddd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:35.706200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bc9fc-d138-4af5-93ca-95e45f4156d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:35.707035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bc9fc-d138-4af5-93ca-95e45f4156d4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:35.707388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bc9fc-d138-4af5-93ca-95e45f4156d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:35.707734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bc9fc-d138-4af5-93ca-95e45f4156d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:35.746536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:35.788353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bc9fc-d138-4af5-93ca-95e45f4156d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:35.789778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bc9fc-d138-4af5-93ca-95e45f4156d4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:35.926929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 603/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:24:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:24:35.928226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7e310-5dd4-428e-9192-3773fd51cff0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:35.947721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:36.053842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7e310-5dd4-428e-9192-3773fd51cff0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:36.106653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59fba1-8a59-4915-8444-a1f5a2f09b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:36.108058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59fba1-8a59-4915-8444-a1f5a2f09b47 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:36.108354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59fba1-8a59-4915-8444-a1f5a2f09b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:36.108749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59fba1-8a59-4915-8444-a1f5a2f09b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:36.123111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59fba1-8a59-4915-8444-a1f5a2f09b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:36.124579 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59fba1-8a59-4915-8444-a1f5a2f09b47 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4c59fba1-8a59-4915-8444-a1f5a2f09b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:36.141253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:36.142299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:36.143464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:36.143464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:36.143464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:36.143464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 612/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:36.148456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bc9fc-d138-4af5-93ca-95e45f4156d4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:36.215524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:36.265455 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bc9fc-d138-4af5-93ca-95e45f4156d4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:36.302063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea5052-7450-429f-b90d-3f01cb2b7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:36.302664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea5052-7450-429f-b90d-3f01cb2b7c81 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:36.302984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea5052-7450-429f-b90d-3f01cb2b7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:36.303251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea5052-7450-429f-b90d-3f01cb2b7c81 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:36.303941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea5052-7450-429f-b90d-3f01cb2b7c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:36.304256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea5052-7450-429f-b90d-3f01cb2b7c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:36.305632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea5052-7450-429f-b90d-3f01cb2b7c81 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:36.318285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 604/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:36.323626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59fba1-8a59-4915-8444-a1f5a2f09b47 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:36.405000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:36.441069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59fba1-8a59-4915-8444-a1f5a2f09b47 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:36.476564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48911df0-7fd2-4ead-aa5d-4a1ba76224f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:36.477233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48911df0-7fd2-4ead-aa5d-4a1ba76224f1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:36.477516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48911df0-7fd2-4ead-aa5d-4a1ba76224f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:36.477786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48911df0-7fd2-4ead-aa5d-4a1ba76224f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:36.485092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48911df0-7fd2-4ead-aa5d-4a1ba76224f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:36.486667 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48911df0-7fd2-4ead-aa5d-4a1ba76224f1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-48911df0-7fd2-4ead-aa5d-4a1ba76224f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:24:36.498717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:36.499858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:36.501203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:24:36.501203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:24:36.501203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:24:36.501203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:24:36.501203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:24:36.501203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:24:36.501203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:36.501203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:36.501203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 613/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:36.505984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea5052-7450-429f-b90d-3f01cb2b7c81 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:36.616495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea5052-7450-429f-b90d-3f01cb2b7c81 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:36.641417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:36.656561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d0bf1-edbf-4071-83da-c49727801195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:36.657169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0bf1-edbf-4071-83da-c49727801195 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:36.657449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0bf1-edbf-4071-83da-c49727801195 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:36.657725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0bf1-edbf-4071-83da-c49727801195 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:36.658438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d0bf1-edbf-4071-83da-c49727801195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:36.658778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d0bf1-edbf-4071-83da-c49727801195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:36.660343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d0bf1-edbf-4071-83da-c49727801195 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:36.676610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 605/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:36.682588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48911df0-7fd2-4ead-aa5d-4a1ba76224f1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:36.795971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48911df0-7fd2-4ead-aa5d-4a1ba76224f1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:36.830196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:36.837385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b455c5-4287-4fc4-8203-f033aec59093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:36.837987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b455c5-4287-4fc4-8203-f033aec59093 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:36.838270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b455c5-4287-4fc4-8203-f033aec59093 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:36.838547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b455c5-4287-4fc4-8203-f033aec59093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:36.839354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b455c5-4287-4fc4-8203-f033aec59093 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=cc99489aa0e14928871b6f7b2c955068) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:36.839672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b455c5-4287-4fc4-8203-f033aec59093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:36.841158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b455c5-4287-4fc4-8203-f033aec59093 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:36.848279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 614/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:24:36 2022] GET /identity/v3/role_assignments?user.id=cc99489aa0e14928871b6f7b2c955068&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:38.937238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1badb3-9a0a-4910-bfe3-73914a79929b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:38.937778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1badb3-9a0a-4910-bfe3-73914a79929b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:38.937778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1badb3-9a0a-4910-bfe3-73914a79929b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:38.939601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 606/1220] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:24:38.945340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833c910-c752-4d69-bcc4-e16c8ca0d45a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:38.945901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833c910-c752-4d69-bcc4-e16c8ca0d45a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:38.946067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833c910-c752-4d69-bcc4-e16c8ca0d45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:38.968640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c833c910-c752-4d69-bcc4-e16c8ca0d45a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:38.969944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c833c910-c752-4d69-bcc4-e16c8ca0d45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:39.042132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 615/1221] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:24:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:24:39.315875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1badb3-9a0a-4910-bfe3-73914a79929b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:39.424378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1badb3-9a0a-4910-bfe3-73914a79929b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:39.461322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096b5d-923f-421d-8621-d21825d7cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:39.461951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096b5d-923f-421d-8621-d21825d7cb36 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:39.462229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096b5d-923f-421d-8621-d21825d7cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:39.462502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096b5d-923f-421d-8621-d21825d7cb36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:39.472895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096b5d-923f-421d-8621-d21825d7cb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-1f096b5d-923f-421d-8621-d21825d7cb36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:24:39.479356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:39.480358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:39.481404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 607/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:24:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:39.487320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833c910-c752-4d69-bcc4-e16c8ca0d45a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:39.594873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833c910-c752-4d69-bcc4-e16c8ca0d45a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:39.618348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:39.632645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a2ac0-ea8e-41c1-bf9f-18a8b33149cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:39.633381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a2ac0-ea8e-41c1-bf9f-18a8b33149cd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:39.633759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a2ac0-ea8e-41c1-bf9f-18a8b33149cd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:39.634268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a2ac0-ea8e-41c1-bf9f-18a8b33149cd None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:39.635006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a2ac0-ea8e-41c1-bf9f-18a8b33149cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:39.635316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a2ac0-ea8e-41c1-bf9f-18a8b33149cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:39.636996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a2ac0-ea8e-41c1-bf9f-18a8b33149cd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:39.647981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 616/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:24:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:39.654205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096b5d-923f-421d-8621-d21825d7cb36 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:39.706378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:39.765921 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096b5d-923f-421d-8621-d21825d7cb36 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:39.800866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4996-ab95-4ff7-9b4a-3e182e7404f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:39.801491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4996-ab95-4ff7-9b4a-3e182e7404f9 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:39.801769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4996-ab95-4ff7-9b4a-3e182e7404f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:39.802037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4996-ab95-4ff7-9b4a-3e182e7404f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:39.812967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf4996-ab95-4ff7-9b4a-3e182e7404f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:39.814544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf4996-ab95-4ff7-9b4a-3e182e7404f9 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-61bf4996-ab95-4ff7-9b4a-3e182e7404f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:39.830736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:39.831949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:39.833017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:39.833017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:39.833017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:39.833017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 608/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:39.837833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a2ac0-ea8e-41c1-bf9f-18a8b33149cd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:39.945778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a2ac0-ea8e-41c1-bf9f-18a8b33149cd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:39.982619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058ff51-6fb7-4359-b77d-76daf5d24210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:39.983261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058ff51-6fb7-4359-b77d-76daf5d24210 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:39.983568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058ff51-6fb7-4359-b77d-76daf5d24210 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:39.983861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058ff51-6fb7-4359-b77d-76daf5d24210 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:39.984463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058ff51-6fb7-4359-b77d-76daf5d24210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:39.984767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058ff51-6fb7-4359-b77d-76daf5d24210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:39.986142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058ff51-6fb7-4359-b77d-76daf5d24210 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:39.999562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 617/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:40.005290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4996-ab95-4ff7-9b4a-3e182e7404f9 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:40.111471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:40.118427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4996-ab95-4ff7-9b4a-3e182e7404f9 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:40.154503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ed43a-f713-4618-93d2-5933d8708711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:40.155164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ed43a-f713-4618-93d2-5933d8708711 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:40.155443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ed43a-f713-4618-93d2-5933d8708711 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:40.155714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ed43a-f713-4618-93d2-5933d8708711 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:40.163330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ed43a-f713-4618-93d2-5933d8708711 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:40.164794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ed43a-f713-4618-93d2-5933d8708711 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8d5ed43a-f713-4618-93d2-5933d8708711 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:24:40.177492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:40.178648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:40.179659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 609/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:40.184681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058ff51-6fb7-4359-b77d-76daf5d24210 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:40.235973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:40.294158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058ff51-6fb7-4359-b77d-76daf5d24210 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:40.334750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01a9d2-6d91-43be-a2bc-05de201612f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:40.335479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01a9d2-6d91-43be-a2bc-05de201612f7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:40.335829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01a9d2-6d91-43be-a2bc-05de201612f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:40.336090 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01a9d2-6d91-43be-a2bc-05de201612f7 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:40.336996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01a9d2-6d91-43be-a2bc-05de201612f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:40.337298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01a9d2-6d91-43be-a2bc-05de201612f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:40.339112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01a9d2-6d91-43be-a2bc-05de201612f7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:40.358408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 618/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 31 11:24:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:40.364283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ed43a-f713-4618-93d2-5933d8708711 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:40.472158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ed43a-f713-4618-93d2-5933d8708711 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:40.507294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939841-3cd1-4fc4-9285-81f652eb033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:40.507922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939841-3cd1-4fc4-9285-81f652eb033f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:40.508205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939841-3cd1-4fc4-9285-81f652eb033f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:40.508476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939841-3cd1-4fc4-9285-81f652eb033f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:40.520158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce939841-3cd1-4fc4-9285-81f652eb033f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:40.521606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce939841-3cd1-4fc4-9285-81f652eb033f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ce939841-3cd1-4fc4-9285-81f652eb033f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:40.537009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:40.538262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:40.539453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:40.539453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:40.539453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:40.539453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 610/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:40.545152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01a9d2-6d91-43be-a2bc-05de201612f7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:40.656760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01a9d2-6d91-43be-a2bc-05de201612f7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:40.659423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:40.699996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89fee5-ba8b-4bce-9eb4-b243a1955c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:40.700670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89fee5-ba8b-4bce-9eb4-b243a1955c6d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:40.700975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89fee5-ba8b-4bce-9eb4-b243a1955c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:40.701241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89fee5-ba8b-4bce-9eb4-b243a1955c6d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:40.701928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89fee5-ba8b-4bce-9eb4-b243a1955c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:40.702231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89fee5-ba8b-4bce-9eb4-b243a1955c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:40.703668 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89fee5-ba8b-4bce-9eb4-b243a1955c6d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:40.715489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 619/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:40.721415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939841-3cd1-4fc4-9285-81f652eb033f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:40.733178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:40.831103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939841-3cd1-4fc4-9285-81f652eb033f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:40.867592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7cfb3-3b1b-402c-b1c6-30be196b8fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:40.867592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7cfb3-3b1b-402c-b1c6-30be196b8fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:40.868062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7cfb3-3b1b-402c-b1c6-30be196b8fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:40.868280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7cfb3-3b1b-402c-b1c6-30be196b8fe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:40.876152 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7cfb3-3b1b-402c-b1c6-30be196b8fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:40.877608 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7cfb3-3b1b-402c-b1c6-30be196b8fe1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-90d7cfb3-3b1b-402c-b1c6-30be196b8fe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:24:40.889788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:40.890931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:40.891848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:24:40.891848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:24:40.891848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:24:40.891848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:24:40.891848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:24:40.891848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:24:40.891848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:40.891848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:40.891848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 611/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:40.897364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89fee5-ba8b-4bce-9eb4-b243a1955c6d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:41.020546 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89fee5-ba8b-4bce-9eb4-b243a1955c6d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:41.063466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cfcfc-b983-4270-a5c4-7fb5feadc9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:41.064123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cfcfc-b983-4270-a5c4-7fb5feadc9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:41.064434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cfcfc-b983-4270-a5c4-7fb5feadc9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:41.064741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cfcfc-b983-4270-a5c4-7fb5feadc9d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:41.065479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cfcfc-b983-4270-a5c4-7fb5feadc9d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:41.065811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cfcfc-b983-4270-a5c4-7fb5feadc9d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:41.067392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cfcfc-b983-4270-a5c4-7fb5feadc9d6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:41.081424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 620/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:41.087509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7cfb3-3b1b-402c-b1c6-30be196b8fe1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:41.166300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:41.205660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7cfb3-3b1b-402c-b1c6-30be196b8fe1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:41.245524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68a481-a01c-464d-8087-c8c7593e2857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:41.247104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68a481-a01c-464d-8087-c8c7593e2857 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:41.249007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68a481-a01c-464d-8087-c8c7593e2857 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:41.249529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68a481-a01c-464d-8087-c8c7593e2857 None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/cc99489aa0e14928871b6f7b2c955068/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:41.270609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68a481-a01c-464d-8087-c8c7593e2857 None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=cc99489aa0e14928871b6f7b2c955068, role_id=2c1fea0d72b84ff7b73cb582f4cf3a9e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:41.272381 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68a481-a01c-464d-8087-c8c7593e2857 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:41.286669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 612/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:24:41 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/cc99489aa0e14928871b6f7b2c955068/roles/2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:24:43.316687 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d94da-37e5-4d12-8f33-3f2e52bec46a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:43.317254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d94da-37e5-4d12-8f33-3f2e52bec46a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:43.317428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d94da-37e5-4d12-8f33-3f2e52bec46a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:43.318974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 621/1233] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:24:43.328615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca66584-c11b-4ef6-9d68-b6c145c49b59 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:43.328615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca66584-c11b-4ef6-9d68-b6c145c49b59 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:43.328615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca66584-c11b-4ef6-9d68-b6c145c49b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:43.347577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7ca66584-c11b-4ef6-9d68-b6c145c49b59 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:43.349148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7ca66584-c11b-4ef6-9d68-b6c145c49b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:43.432790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 613/1234] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:24:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:24:43.712861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d94da-37e5-4d12-8f33-3f2e52bec46a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:43.745825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:43.848226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d94da-37e5-4d12-8f33-3f2e52bec46a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:43.888720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65a50c-8d4d-4e05-a60e-77ae26092c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:43.889370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a50c-8d4d-4e05-a60e-77ae26092c44 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:43.889652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a50c-8d4d-4e05-a60e-77ae26092c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:43.889923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a50c-8d4d-4e05-a60e-77ae26092c44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:43.901478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65a50c-8d4d-4e05-a60e-77ae26092c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8b65a50c-8d4d-4e05-a60e-77ae26092c44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:24:43.908607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:43.909583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:43.910419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 622/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 31 11:24:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:43.915768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca66584-c11b-4ef6-9d68-b6c145c49b59 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:43.968633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:44.025939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca66584-c11b-4ef6-9d68-b6c145c49b59 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:44.064675 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d73a21-fabf-4fac-bf23-c9361d996f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:44.065308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d73a21-fabf-4fac-bf23-c9361d996f32 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:44.065574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d73a21-fabf-4fac-bf23-c9361d996f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:44.065894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d73a21-fabf-4fac-bf23-c9361d996f32 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:44.066640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d73a21-fabf-4fac-bf23-c9361d996f32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:44.066973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d73a21-fabf-4fac-bf23-c9361d996f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:44.068475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d73a21-fabf-4fac-bf23-c9361d996f32 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:44.078195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 614/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 31 11:24:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:44.083930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65a50c-8d4d-4e05-a60e-77ae26092c44 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:44.184785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:44.206194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65a50c-8d4d-4e05-a60e-77ae26092c44 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:44.245619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec19b96-5ab5-4b84-b114-34d4c77c4d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:44.246258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19b96-5ab5-4b84-b114-34d4c77c4d05 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:44.246536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19b96-5ab5-4b84-b114-34d4c77c4d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:44.246846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19b96-5ab5-4b84-b114-34d4c77c4d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:44.257464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec19b96-5ab5-4b84-b114-34d4c77c4d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:44.259028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec19b96-5ab5-4b84-b114-34d4c77c4d05 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dec19b96-5ab5-4b84-b114-34d4c77c4d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:44.274493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:44.275821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:44.276920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:44.276920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:44.276920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:44.278327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 623/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:24:44.285144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d73a21-fabf-4fac-bf23-c9361d996f32 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:44.396355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d73a21-fabf-4fac-bf23-c9361d996f32 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:44.406625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:44.433548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9736-8c34-4d31-9230-c48afe84a21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:44.434139 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9736-8c34-4d31-9230-c48afe84a21c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:44.434416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9736-8c34-4d31-9230-c48afe84a21c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:44.434764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9736-8c34-4d31-9230-c48afe84a21c None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:44.435567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f9736-8c34-4d31-9230-c48afe84a21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:44.435911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f9736-8c34-4d31-9230-c48afe84a21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:44.437328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f9736-8c34-4d31-9230-c48afe84a21c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:44.449325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 615/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:44.455844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec19b96-5ab5-4b84-b114-34d4c77c4d05 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:44.565402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec19b96-5ab5-4b84-b114-34d4c77c4d05 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:44.600577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c5a8c-aa68-4250-82d4-4107cebf79c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:44.601481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c5a8c-aa68-4250-82d4-4107cebf79c3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:44.601753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c5a8c-aa68-4250-82d4-4107cebf79c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:44.602051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c5a8c-aa68-4250-82d4-4107cebf79c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:44.605171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:44.610852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c5a8c-aa68-4250-82d4-4107cebf79c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:44.612782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c5a8c-aa68-4250-82d4-4107cebf79c3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-455c5a8c-aa68-4250-82d4-4107cebf79c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:24:44.628213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:44.629213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:44.630328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 624/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:24:44.636663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9736-8c34-4d31-9230-c48afe84a21c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:44.748834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9736-8c34-4d31-9230-c48afe84a21c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:44.788822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e6f6f-8400-41d0-93a6-276fcd64340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:44.789431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e6f6f-8400-41d0-93a6-276fcd64340e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:44.789709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e6f6f-8400-41d0-93a6-276fcd64340e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:44.789980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e6f6f-8400-41d0-93a6-276fcd64340e None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:44.790739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e6f6f-8400-41d0-93a6-276fcd64340e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:44.791208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e6f6f-8400-41d0-93a6-276fcd64340e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:44.792640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e6f6f-8400-41d0-93a6-276fcd64340e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:44.811313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 616/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 31 11:24:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:44.817633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c5a8c-aa68-4250-82d4-4107cebf79c3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:44.926713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c5a8c-aa68-4250-82d4-4107cebf79c3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:44.966102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229f38f-36ab-44ad-81a5-75e909702cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:44.966848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229f38f-36ab-44ad-81a5-75e909702cca None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:44.967144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229f38f-36ab-44ad-81a5-75e909702cca None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:44.967417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229f38f-36ab-44ad-81a5-75e909702cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:45.040246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:45.048414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229f38f-36ab-44ad-81a5-75e909702cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:45.049878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229f38f-36ab-44ad-81a5-75e909702cca None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:45.155890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 625/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:24:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:24:45.161703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e6f6f-8400-41d0-93a6-276fcd64340e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:45.192632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:45.266612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e6f6f-8400-41d0-93a6-276fcd64340e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:45.304541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed233138-9199-42a0-af2f-760feffee906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:45.305174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233138-9199-42a0-af2f-760feffee906 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:45.305453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233138-9199-42a0-af2f-760feffee906 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:45.305725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233138-9199-42a0-af2f-760feffee906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:45.316590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed233138-9199-42a0-af2f-760feffee906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:45.318084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed233138-9199-42a0-af2f-760feffee906 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ed233138-9199-42a0-af2f-760feffee906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:45.337188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:45.338465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:45.339414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:45.339414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:45.339414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:45.339414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 617/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:24:45.345519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229f38f-36ab-44ad-81a5-75e909702cca None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:45.454721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:45.462304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229f38f-36ab-44ad-81a5-75e909702cca None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:45.501216 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae100d84-d805-4bc6-b459-d90536008682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:45.501844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae100d84-d805-4bc6-b459-d90536008682 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:45.502134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae100d84-d805-4bc6-b459-d90536008682 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:45.502403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae100d84-d805-4bc6-b459-d90536008682 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:45.503130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae100d84-d805-4bc6-b459-d90536008682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:45.503468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae100d84-d805-4bc6-b459-d90536008682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:45.504948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae100d84-d805-4bc6-b459-d90536008682 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:45.517242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 626/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:45.523133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed233138-9199-42a0-af2f-760feffee906 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:45.611800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:45.634849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed233138-9199-42a0-af2f-760feffee906 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:45.672861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef27b8c-260f-4125-8b84-4d947d93fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:45.673504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef27b8c-260f-4125-8b84-4d947d93fc41 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:45.673798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef27b8c-260f-4125-8b84-4d947d93fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:45.674054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef27b8c-260f-4125-8b84-4d947d93fc41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:45.681690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef27b8c-260f-4125-8b84-4d947d93fc41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:45.683247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef27b8c-260f-4125-8b84-4d947d93fc41 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3ef27b8c-260f-4125-8b84-4d947d93fc41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:24:45.696299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:45.697341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:45.703847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:24:45.703847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:24:45.703847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:24:45.703847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:24:45.703847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:24:45.703847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:24:45.703847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:45.703847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:45.703847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 618/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:45.704419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae100d84-d805-4bc6-b459-d90536008682 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:45.823441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae100d84-d805-4bc6-b459-d90536008682 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:45.860525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afda22-64b5-4062-8e92-601bbf3c9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:45.861136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afda22-64b5-4062-8e92-601bbf3c9745 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:45.861426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afda22-64b5-4062-8e92-601bbf3c9745 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:45.861704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afda22-64b5-4062-8e92-601bbf3c9745 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:45.862440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afda22-64b5-4062-8e92-601bbf3c9745 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:45.862781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afda22-64b5-4062-8e92-601bbf3c9745 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:45.864249 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afda22-64b5-4062-8e92-601bbf3c9745 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:45.879633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 627/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:24:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:45.885970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef27b8c-260f-4125-8b84-4d947d93fc41 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:46.003048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef27b8c-260f-4125-8b84-4d947d93fc41 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:46.045338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83450d0-0964-4b6f-9f8c-fbf74a1c2745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:46.046045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83450d0-0964-4b6f-9f8c-fbf74a1c2745 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:46.046489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83450d0-0964-4b6f-9f8c-fbf74a1c2745 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:46.046924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83450d0-0964-4b6f-9f8c-fbf74a1c2745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:46.047790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83450d0-0964-4b6f-9f8c-fbf74a1c2745 None admin] RBAC: Adding query filter params (role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=cc99489aa0e14928871b6f7b2c955068) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:46.048121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83450d0-0964-4b6f-9f8c-fbf74a1c2745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:46.049846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83450d0-0964-4b6f-9f8c-fbf74a1c2745 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:46.057509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 619/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:24:45 2022] GET /identity/v3/role_assignments?user.id=cc99489aa0e14928871b6f7b2c955068&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=2c1fea0d72b84ff7b73cb582f4cf3a9e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:48.225484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1e584-1986-4dcb-bc9e-0b6682b7a350 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:48.226078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1e584-1986-4dcb-bc9e-0b6682b7a350 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:48.226078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1e584-1986-4dcb-bc9e-0b6682b7a350 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:48.227875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 628/1247] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:24:48.233910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426919e3-e599-4c43-aa86-7b9d3594c358 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:48.234398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426919e3-e599-4c43-aa86-7b9d3594c358 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:48.234506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426919e3-e599-4c43-aa86-7b9d3594c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:48.241104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:48.255293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-426919e3-e599-4c43-aa86-7b9d3594c358 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:48.256588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-426919e3-e599-4c43-aa86-7b9d3594c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:48.333772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 620/1248] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:24:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:24:48.614449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1e584-1986-4dcb-bc9e-0b6682b7a350 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:48.634053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:48.726836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1e584-1986-4dcb-bc9e-0b6682b7a350 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:48.764338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821677e6-c5c5-47e8-bbfa-f9b0355bf15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:48.765120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821677e6-c5c5-47e8-bbfa-f9b0355bf15e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:48.765497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821677e6-c5c5-47e8-bbfa-f9b0355bf15e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:48.765815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821677e6-c5c5-47e8-bbfa-f9b0355bf15e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:48.776479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821677e6-c5c5-47e8-bbfa-f9b0355bf15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-821677e6-c5c5-47e8-bbfa-f9b0355bf15e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:24:48.782883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:48.783858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:48.784731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 629/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:48.790887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426919e3-e599-4c43-aa86-7b9d3594c358 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:48.903174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426919e3-e599-4c43-aa86-7b9d3594c358 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:48.937407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:48.943221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202ff1d-51db-4415-af23-ad202da89b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:48.943849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202ff1d-51db-4415-af23-ad202da89b55 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:48.944120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202ff1d-51db-4415-af23-ad202da89b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:48.944390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202ff1d-51db-4415-af23-ad202da89b55 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:48.945054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202ff1d-51db-4415-af23-ad202da89b55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:48.945358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202ff1d-51db-4415-af23-ad202da89b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:48.946753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202ff1d-51db-4415-af23-ad202da89b55 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:48.956158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 621/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:48.962047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821677e6-c5c5-47e8-bbfa-f9b0355bf15e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:49.053012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:49.080224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821677e6-c5c5-47e8-bbfa-f9b0355bf15e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:49.126152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b3fcd-1e5c-4ac5-a943-fc9ba4a79c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:49.126829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b3fcd-1e5c-4ac5-a943-fc9ba4a79c55 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:49.127110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b3fcd-1e5c-4ac5-a943-fc9ba4a79c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:49.127502 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b3fcd-1e5c-4ac5-a943-fc9ba4a79c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:49.145749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b3fcd-1e5c-4ac5-a943-fc9ba4a79c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:49.147398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b3fcd-1e5c-4ac5-a943-fc9ba4a79c55 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-371b3fcd-1e5c-4ac5-a943-fc9ba4a79c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:49.165128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:49.166200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:49.167161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:49.167161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:49.167161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:49.167161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 630/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:49.173392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202ff1d-51db-4415-af23-ad202da89b55 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:49.291486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202ff1d-51db-4415-af23-ad202da89b55 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:49.333860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b42580-2429-42ef-885c-b9521c339b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:49.334578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b42580-2429-42ef-885c-b9521c339b09 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:49.334912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b42580-2429-42ef-885c-b9521c339b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:49.335143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b42580-2429-42ef-885c-b9521c339b09 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:49.336085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b42580-2429-42ef-885c-b9521c339b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:49.336397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b42580-2429-42ef-885c-b9521c339b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:49.337996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b42580-2429-42ef-885c-b9521c339b09 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:49.356261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 622/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:49.363100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b3fcd-1e5c-4ac5-a943-fc9ba4a79c55 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:49.474989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b3fcd-1e5c-4ac5-a943-fc9ba4a79c55 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:49.504113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:49.512605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d4f65-5bda-435c-bb21-0937852e9e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:49.513267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d4f65-5bda-435c-bb21-0937852e9e8d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:49.513541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d4f65-5bda-435c-bb21-0937852e9e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:49.513818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d4f65-5bda-435c-bb21-0937852e9e8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:49.522148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d4f65-5bda-435c-bb21-0937852e9e8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:49.523671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d4f65-5bda-435c-bb21-0937852e9e8d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1c2d4f65-5bda-435c-bb21-0937852e9e8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:24:49.539136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:49.540607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:49.541666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 631/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:49.547256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b42580-2429-42ef-885c-b9521c339b09 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:49.608095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:49.657476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b42580-2429-42ef-885c-b9521c339b09 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:49.695043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7052ac-006c-498b-a86a-bc870050107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:49.695632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7052ac-006c-498b-a86a-bc870050107a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:49.695905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7052ac-006c-498b-a86a-bc870050107a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:49.696170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7052ac-006c-498b-a86a-bc870050107a None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:49.696889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7052ac-006c-498b-a86a-bc870050107a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:49.697187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7052ac-006c-498b-a86a-bc870050107a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:49.698604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7052ac-006c-498b-a86a-bc870050107a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:49.715585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 623/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 31 11:24:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:49.721608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d4f65-5bda-435c-bb21-0937852e9e8d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:49.832810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d4f65-5bda-435c-bb21-0937852e9e8d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:49.871943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8a931-c66c-4ef0-b581-fed1e174af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:49.872666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a931-c66c-4ef0-b581-fed1e174af15 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:49.872967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a931-c66c-4ef0-b581-fed1e174af15 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:49.873239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a931-c66c-4ef0-b581-fed1e174af15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:49.930758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:49.945500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8a931-c66c-4ef0-b581-fed1e174af15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:49.946989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8a931-c66c-4ef0-b581-fed1e174af15 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:50.066117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 632/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:24:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 11:24:50.067478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7052ac-006c-498b-a86a-bc870050107a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:50.180957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7052ac-006c-498b-a86a-bc870050107a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:50.194462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:50.217623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f504e-a065-4466-ae82-1d09a4b5f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:50.218260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f504e-a065-4466-ae82-1d09a4b5f874 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:50.218540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f504e-a065-4466-ae82-1d09a4b5f874 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:50.218900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f504e-a065-4466-ae82-1d09a4b5f874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:50.229673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f504e-a065-4466-ae82-1d09a4b5f874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:50.231152 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f504e-a065-4466-ae82-1d09a4b5f874 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ff2f504e-a065-4466-ae82-1d09a4b5f874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:50.246875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:50.247977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:50.249035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:50.249035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:50.249035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:50.249035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 624/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:24:50.254060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8a931-c66c-4ef0-b581-fed1e174af15 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:50.345336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:50.362218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8a931-c66c-4ef0-b581-fed1e174af15 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:50.399271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec199b57-0f87-47dc-8896-4d97bcecd96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:50.399945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec199b57-0f87-47dc-8896-4d97bcecd96f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:50.400108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec199b57-0f87-47dc-8896-4d97bcecd96f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:50.400361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec199b57-0f87-47dc-8896-4d97bcecd96f None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:50.401060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec199b57-0f87-47dc-8896-4d97bcecd96f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:50.401382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec199b57-0f87-47dc-8896-4d97bcecd96f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:50.402963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec199b57-0f87-47dc-8896-4d97bcecd96f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:50.418010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 633/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:50.424425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f504e-a065-4466-ae82-1d09a4b5f874 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:50.541176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f504e-a065-4466-ae82-1d09a4b5f874 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:50.578467 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dc0fb-775c-4352-b62d-23ed31e0cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:50.579134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc0fb-775c-4352-b62d-23ed31e0cd70 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:50.579414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc0fb-775c-4352-b62d-23ed31e0cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:50.579687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dc0fb-775c-4352-b62d-23ed31e0cd70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:50.587431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dc0fb-775c-4352-b62d-23ed31e0cd70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:50.588906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dc0fb-775c-4352-b62d-23ed31e0cd70 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ad8dc0fb-775c-4352-b62d-23ed31e0cd70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:24:50.602153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:50.603248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:50.604280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:24:50.604280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:24:50.604280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:24:50.604280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:24:50.604280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:24:50.604280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:24:50.604280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:50.604280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:50.604280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 625/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:24:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:50.609706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec199b57-0f87-47dc-8896-4d97bcecd96f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:50.715082 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec199b57-0f87-47dc-8896-4d97bcecd96f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:50.750865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64395fd6-852d-41f0-afe4-e7a3143c886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:50.751485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395fd6-852d-41f0-afe4-e7a3143c886f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:50.751761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395fd6-852d-41f0-afe4-e7a3143c886f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:50.752030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395fd6-852d-41f0-afe4-e7a3143c886f None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:50.752729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64395fd6-852d-41f0-afe4-e7a3143c886f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:50.753029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64395fd6-852d-41f0-afe4-e7a3143c886f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:50.754473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64395fd6-852d-41f0-afe4-e7a3143c886f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:50.768416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 634/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:50.774670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dc0fb-775c-4352-b62d-23ed31e0cd70 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:50.802614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:50.882515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dc0fb-775c-4352-b62d-23ed31e0cd70 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:50.916629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53da0e-9219-4868-bfba-4ec358200bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:50.917223 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53da0e-9219-4868-bfba-4ec358200bfc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:50.917500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53da0e-9219-4868-bfba-4ec358200bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:50.917770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53da0e-9219-4868-bfba-4ec358200bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:50.918491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53da0e-9219-4868-bfba-4ec358200bfc None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=cc99489aa0e14928871b6f7b2c955068) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:50.918829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53da0e-9219-4868-bfba-4ec358200bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:50.920282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53da0e-9219-4868-bfba-4ec358200bfc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:50.925867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 626/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:24:50 2022] GET /identity/v3/role_assignments?user.id=cc99489aa0e14928871b6f7b2c955068&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=946af2ff291349299db56e09aacb6b03 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:52.796797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5382c4-a89a-4e3c-a69e-95e532f9fe78 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:52.797336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5382c4-a89a-4e3c-a69e-95e532f9fe78 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:52.797336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5382c4-a89a-4e3c-a69e-95e532f9fe78 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:52.798690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 635/1261] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:24:52.803670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908fc7-fb4a-49a1-bef2-455775028591 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:52.804088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908fc7-fb4a-49a1-bef2-455775028591 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:52.804209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908fc7-fb4a-49a1-bef2-455775028591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:52.822754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f6908fc7-fb4a-49a1-bef2-455775028591 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:52.823933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f6908fc7-fb4a-49a1-bef2-455775028591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:52.889248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 627/1262] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:24:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:24:53.157478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5382c4-a89a-4e3c-a69e-95e532f9fe78 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:53.168366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:53.257784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5382c4-a89a-4e3c-a69e-95e532f9fe78 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:53.291564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2132e2a-80df-4639-be04-07957cefceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:53.292179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2132e2a-80df-4639-be04-07957cefceab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:53.292454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2132e2a-80df-4639-be04-07957cefceab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:53.292725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2132e2a-80df-4639-be04-07957cefceab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:53.302737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2132e2a-80df-4639-be04-07957cefceab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a2132e2a-80df-4639-be04-07957cefceab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:24:53.307572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:53.308627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:53.309648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 636/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:53.315510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908fc7-fb4a-49a1-bef2-455775028591 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:53.333617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:53.413372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908fc7-fb4a-49a1-bef2-455775028591 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:53.446258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997614ec-af2d-4015-b4d0-cc3f2bffac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:53.446882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997614ec-af2d-4015-b4d0-cc3f2bffac9f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:53.447162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997614ec-af2d-4015-b4d0-cc3f2bffac9f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:53.447435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997614ec-af2d-4015-b4d0-cc3f2bffac9f None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:53.448091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997614ec-af2d-4015-b4d0-cc3f2bffac9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:53.448392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997614ec-af2d-4015-b4d0-cc3f2bffac9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:53.449762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997614ec-af2d-4015-b4d0-cc3f2bffac9f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:53.458192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 628/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:53.463994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2132e2a-80df-4639-be04-07957cefceab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:53.527987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:53.561378 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2132e2a-80df-4639-be04-07957cefceab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:53.593209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaedc9-3499-4161-b2b0-e9164b439c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:53.593821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaedc9-3499-4161-b2b0-e9164b439c8c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:53.594093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaedc9-3499-4161-b2b0-e9164b439c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:53.594361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaedc9-3499-4161-b2b0-e9164b439c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:53.604713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaedc9-3499-4161-b2b0-e9164b439c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:53.606148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaedc9-3499-4161-b2b0-e9164b439c8c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6bfaedc9-3499-4161-b2b0-e9164b439c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:53.620169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:53.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:53.623075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:53.623075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:53.623075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:53.623075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 637/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:53.627620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997614ec-af2d-4015-b4d0-cc3f2bffac9f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:53.707382 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:53.726948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997614ec-af2d-4015-b4d0-cc3f2bffac9f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:53.760669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a171e-733d-4e1d-8012-0a74a2b02823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:53.761256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a171e-733d-4e1d-8012-0a74a2b02823 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:53.761529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a171e-733d-4e1d-8012-0a74a2b02823 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:53.761796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a171e-733d-4e1d-8012-0a74a2b02823 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:53.762419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a171e-733d-4e1d-8012-0a74a2b02823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:53.762739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a171e-733d-4e1d-8012-0a74a2b02823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:53.764568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a171e-733d-4e1d-8012-0a74a2b02823 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:53.775674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 629/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:53.781382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaedc9-3499-4161-b2b0-e9164b439c8c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:53.879515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaedc9-3499-4161-b2b0-e9164b439c8c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:53.898246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:53.912683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e82d6-82fd-447c-9379-0e0f63012c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:53.913300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e82d6-82fd-447c-9379-0e0f63012c74 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:53.913584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e82d6-82fd-447c-9379-0e0f63012c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:53.913860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e82d6-82fd-447c-9379-0e0f63012c74 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:53.921824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e82d6-82fd-447c-9379-0e0f63012c74 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:53.923248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e82d6-82fd-447c-9379-0e0f63012c74 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b35e82d6-82fd-447c-9379-0e0f63012c74 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:24:53.934099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:53.935310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:53.936531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 638/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:53.941171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a171e-733d-4e1d-8012-0a74a2b02823 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:54.039472 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a171e-733d-4e1d-8012-0a74a2b02823 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:54.075110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38b342-f030-4c61-9f23-86f52ebf9e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:54.075918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38b342-f030-4c61-9f23-86f52ebf9e4e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:54.076101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38b342-f030-4c61-9f23-86f52ebf9e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:54.076372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38b342-f030-4c61-9f23-86f52ebf9e4e None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:54.077095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38b342-f030-4c61-9f23-86f52ebf9e4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:54.077399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38b342-f030-4c61-9f23-86f52ebf9e4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:54.078855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38b342-f030-4c61-9f23-86f52ebf9e4e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:54.087286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:54.096319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 630/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 31 11:24:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:54.102277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e82d6-82fd-447c-9379-0e0f63012c74 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:54.198458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e82d6-82fd-447c-9379-0e0f63012c74 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:54.231454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4f4a3-9cc4-4a1b-b7db-2031dee9fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:54.232666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f4a3-9cc4-4a1b-b7db-2031dee9fd7e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:54.232940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f4a3-9cc4-4a1b-b7db-2031dee9fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:54.233211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f4a3-9cc4-4a1b-b7db-2031dee9fd7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:54.243499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4f4a3-9cc4-4a1b-b7db-2031dee9fd7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:54.244947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4f4a3-9cc4-4a1b-b7db-2031dee9fd7e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-48e4f4a3-9cc4-4a1b-b7db-2031dee9fd7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:54.258506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:54.259642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:54.260557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:54.260557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:54.260557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:54.260557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 639/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:54.265359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38b342-f030-4c61-9f23-86f52ebf9e4e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:54.363157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38b342-f030-4c61-9f23-86f52ebf9e4e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:54.396365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166917-673d-4b03-b135-efbfec7a0602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:54.396957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166917-673d-4b03-b135-efbfec7a0602 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:54.397238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166917-673d-4b03-b135-efbfec7a0602 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:54.397508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166917-673d-4b03-b135-efbfec7a0602 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:54.398141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166917-673d-4b03-b135-efbfec7a0602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:54.398440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166917-673d-4b03-b135-efbfec7a0602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:54.399830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166917-673d-4b03-b135-efbfec7a0602 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:54.411246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 631/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:54.416765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4f4a3-9cc4-4a1b-b7db-2031dee9fd7e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:54.447458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:54.515443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4f4a3-9cc4-4a1b-b7db-2031dee9fd7e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:54.548036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c303-7788-4095-8e5d-09e610ed8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:54.548656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c303-7788-4095-8e5d-09e610ed8b71 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:54.548942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c303-7788-4095-8e5d-09e610ed8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:54.549217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c303-7788-4095-8e5d-09e610ed8b71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:54.555795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675c303-7788-4095-8e5d-09e610ed8b71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:54.557246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675c303-7788-4095-8e5d-09e610ed8b71 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c675c303-7788-4095-8e5d-09e610ed8b71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:24:54.568968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:54.570012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:54.576112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:24:54.576112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:24:54.576112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:24:54.576112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:24:54.576112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:24:54.576112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:24:54.576112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:54.576112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:54.576112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 640/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:24:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:54.576714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166917-673d-4b03-b135-efbfec7a0602 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:54.633292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:54.674096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166917-673d-4b03-b135-efbfec7a0602 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:54.707915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f017f-6460-441b-bbe7-772795491d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:54.708514 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f017f-6460-441b-bbe7-772795491d62 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:54.708789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f017f-6460-441b-bbe7-772795491d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:54.709057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f017f-6460-441b-bbe7-772795491d62 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:54.709750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f017f-6460-441b-bbe7-772795491d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:54.710037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f017f-6460-441b-bbe7-772795491d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:54.711491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f017f-6460-441b-bbe7-772795491d62 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:54.723228 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 632/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:54.729237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c303-7788-4095-8e5d-09e610ed8b71 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:54.818316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:54.827903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c303-7788-4095-8e5d-09e610ed8b71 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:54.860351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb46e9-3435-4d7c-b1cd-8460e9a32a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:54.860987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb46e9-3435-4d7c-b1cd-8460e9a32a9b None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:54.861266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb46e9-3435-4d7c-b1cd-8460e9a32a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:54.861533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb46e9-3435-4d7c-b1cd-8460e9a32a9b None admin] PATH_INFO: `/v3/projects/e34048dd48a040f6a440874e3945569f/users/cc99489aa0e14928871b6f7b2c955068/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:54.863362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb46e9-3435-4d7c-b1cd-8460e9a32a9b None admin] RBAC: Authorizing `identity:create_grant(project_id=e34048dd48a040f6a440874e3945569f, user_id=cc99489aa0e14928871b6f7b2c955068, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:54.864786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb46e9-3435-4d7c-b1cd-8460e9a32a9b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:54.877462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 641/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 31 11:24:54 2022] PUT /identity/v3/projects/e34048dd48a040f6a440874e3945569f/users/cc99489aa0e14928871b6f7b2c955068/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:24:56.763778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dc7af-6dca-478a-b6df-72f2025e905d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:56.764323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dc7af-6dca-478a-b6df-72f2025e905d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:56.764323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dc7af-6dca-478a-b6df-72f2025e905d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:56.765672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 633/1274] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:24:56.770647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5e109-762a-44be-9f27-12bf090e099c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:56.771069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5e109-762a-44be-9f27-12bf090e099c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:56.771229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5e109-762a-44be-9f27-12bf090e099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:56.789454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e3b5e109-762a-44be-9f27-12bf090e099c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:56.790634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e3b5e109-762a-44be-9f27-12bf090e099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:56.855402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 642/1275] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:24:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:24:57.129905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dc7af-6dca-478a-b6df-72f2025e905d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:57.228615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dc7af-6dca-478a-b6df-72f2025e905d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:57.245173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:57.262107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421a93-6478-457c-9059-edf8fd0af97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:57.262747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421a93-6478-457c-9059-edf8fd0af97e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:57.263199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421a93-6478-457c-9059-edf8fd0af97e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:57.263478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421a93-6478-457c-9059-edf8fd0af97e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:57.273327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da421a93-6478-457c-9059-edf8fd0af97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-da421a93-6478-457c-9059-edf8fd0af97e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:24:57.278114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:57.280003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:57.280952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 634/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 31 11:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:57.285721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5e109-762a-44be-9f27-12bf090e099c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:57.363973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:57.382558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5e109-762a-44be-9f27-12bf090e099c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:57.417279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8d287-ad2d-4d62-8add-96bd93a9bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:57.417875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8d287-ad2d-4d62-8add-96bd93a9bf6c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:57.418155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8d287-ad2d-4d62-8add-96bd93a9bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:57.418429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8d287-ad2d-4d62-8add-96bd93a9bf6c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:57.419155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8d287-ad2d-4d62-8add-96bd93a9bf6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:57.419703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8d287-ad2d-4d62-8add-96bd93a9bf6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:57.421088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8d287-ad2d-4d62-8add-96bd93a9bf6c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:57.428920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 643/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 31 11:24:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:57.434984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421a93-6478-457c-9059-edf8fd0af97e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:57.532749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421a93-6478-457c-9059-edf8fd0af97e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:57.564975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1946ee-7fb7-4da2-9fdb-07346072821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:57.565579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1946ee-7fb7-4da2-9fdb-07346072821d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:57.565883 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1946ee-7fb7-4da2-9fdb-07346072821d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:57.566154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1946ee-7fb7-4da2-9fdb-07346072821d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:57.576568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1946ee-7fb7-4da2-9fdb-07346072821d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:57.578003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1946ee-7fb7-4da2-9fdb-07346072821d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-2f1946ee-7fb7-4da2-9fdb-07346072821d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:57.592753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:57.593863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:57.594963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:57.594963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:57.594963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:57.594963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 635/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:57.599705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8d287-ad2d-4d62-8add-96bd93a9bf6c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:57.699267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8d287-ad2d-4d62-8add-96bd93a9bf6c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:57.732585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb8350-824f-4a78-9460-b83213274ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:57.733176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb8350-824f-4a78-9460-b83213274ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:57.733455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb8350-824f-4a78-9460-b83213274ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:57.733727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb8350-824f-4a78-9460-b83213274ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:57.734365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb8350-824f-4a78-9460-b83213274ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:57.734667 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb8350-824f-4a78-9460-b83213274ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:57.736073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb8350-824f-4a78-9460-b83213274ad2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:57.747864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 644/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:57.753644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1946ee-7fb7-4da2-9fdb-07346072821d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:57.783691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:57.850520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1946ee-7fb7-4da2-9fdb-07346072821d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:57.882855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610237-2c2f-4150-a53b-cd620a068cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:57.883459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610237-2c2f-4150-a53b-cd620a068cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:57.883735 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610237-2c2f-4150-a53b-cd620a068cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:57.884001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610237-2c2f-4150-a53b-cd620a068cf1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:57.891623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610237-2c2f-4150-a53b-cd620a068cf1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:57.893038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610237-2c2f-4150-a53b-cd620a068cf1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-cc610237-2c2f-4150-a53b-cd620a068cf1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:24:57.903770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:57.904950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:24:57.906374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 636/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:57.910629 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb8350-824f-4a78-9460-b83213274ad2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:57.914464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:58.010121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb8350-824f-4a78-9460-b83213274ad2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:58.046276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbbff3-62c3-4a55-8c3d-69cc7d58fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:58.046910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbbff3-62c3-4a55-8c3d-69cc7d58fde0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:58.047193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbbff3-62c3-4a55-8c3d-69cc7d58fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:58.047468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbbff3-62c3-4a55-8c3d-69cc7d58fde0 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:58.048208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbbff3-62c3-4a55-8c3d-69cc7d58fde0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:58.048515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbbff3-62c3-4a55-8c3d-69cc7d58fde0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:58.049952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbbff3-62c3-4a55-8c3d-69cc7d58fde0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:58.068074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 645/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 31 11:24:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:58.073853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610237-2c2f-4150-a53b-cd620a068cf1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:58.163036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:58.173321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610237-2c2f-4150-a53b-cd620a068cf1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:58.205694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed79a0-20c8-488f-91cc-a81318f4201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:58.206277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed79a0-20c8-488f-91cc-a81318f4201a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:58.206547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed79a0-20c8-488f-91cc-a81318f4201a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:58.206843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed79a0-20c8-488f-91cc-a81318f4201a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:58.271441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed79a0-20c8-488f-91cc-a81318f4201a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:58.272816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed79a0-20c8-488f-91cc-a81318f4201a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:58.357458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:58.367481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 637/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 31 11:24:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:24:58.373833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbbff3-62c3-4a55-8c3d-69cc7d58fde0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:58.433190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:58.470223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbbff3-62c3-4a55-8c3d-69cc7d58fde0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:58.502740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c2514-d04b-49db-a451-dd132874c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:58.503351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c2514-d04b-49db-a451-dd132874c0bf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:58.503624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c2514-d04b-49db-a451-dd132874c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:58.503891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c2514-d04b-49db-a451-dd132874c0bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:58.513440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c2514-d04b-49db-a451-dd132874c0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:58.514914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c2514-d04b-49db-a451-dd132874c0bf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f57c2514-d04b-49db-a451-dd132874c0bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:24:58.530088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:58.531228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:24:58.532466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:24:58.532466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:24:58.532466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:58.532466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 646/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:24:58.536842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed79a0-20c8-488f-91cc-a81318f4201a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:58.631552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed79a0-20c8-488f-91cc-a81318f4201a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:58.663688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e95ec8-bd0e-4b07-8b1f-29f31b653597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:58.664273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e95ec8-bd0e-4b07-8b1f-29f31b653597 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:58.664550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e95ec8-bd0e-4b07-8b1f-29f31b653597 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:58.664818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e95ec8-bd0e-4b07-8b1f-29f31b653597 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:58.665446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e95ec8-bd0e-4b07-8b1f-29f31b653597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:58.665750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e95ec8-bd0e-4b07-8b1f-29f31b653597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:58.667142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e95ec8-bd0e-4b07-8b1f-29f31b653597 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:58.679514 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 638/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 31 11:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:58.685093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c2514-d04b-49db-a451-dd132874c0bf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:58.782487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c2514-d04b-49db-a451-dd132874c0bf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:58.796577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:58.816516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4eeed-df3a-4163-8519-4aad3768c216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:58.817134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4eeed-df3a-4163-8519-4aad3768c216 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:58.817422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4eeed-df3a-4163-8519-4aad3768c216 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:58.817697 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4eeed-df3a-4163-8519-4aad3768c216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:58.824236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4eeed-df3a-4163-8519-4aad3768c216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:58.826179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4eeed-df3a-4163-8519-4aad3768c216 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-62d4eeed-df3a-4163-8519-4aad3768c216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:24:58.837243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:24:58.838268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:24:58.839340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:24:58.839340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:24:58.839340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:24:58.839340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:24:58.839340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:24:58.839340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:24:58.839340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:24:58.839340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 31 11:24:58.839340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 647/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 31 11:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:24:58.844975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e95ec8-bd0e-4b07-8b1f-29f31b653597 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:58.896079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:58.944671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e95ec8-bd0e-4b07-8b1f-29f31b653597 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:58.978063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8529e-b023-4085-9e2d-0ecfeba4978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:58.978658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8529e-b023-4085-9e2d-0ecfeba4978a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:58.978971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8529e-b023-4085-9e2d-0ecfeba4978a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:58.979242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8529e-b023-4085-9e2d-0ecfeba4978a None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:58.979923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8529e-b023-4085-9e2d-0ecfeba4978a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:58.980227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8529e-b023-4085-9e2d-0ecfeba4978a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:58.981680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8529e-b023-4085-9e2d-0ecfeba4978a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:58.993129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 639/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 31 11:24:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:58.999392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4eeed-df3a-4163-8519-4aad3768c216 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:59.102173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4eeed-df3a-4163-8519-4aad3768c216 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:59.133930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852068ed-cddc-4360-8250-f6786bf59d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:59.134484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852068ed-cddc-4360-8250-f6786bf59d02 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:59.134790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852068ed-cddc-4360-8250-f6786bf59d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:59.135065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852068ed-cddc-4360-8250-f6786bf59d02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:59.135783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852068ed-cddc-4360-8250-f6786bf59d02 None admin] RBAC: Adding query filter params (role.id=946af2ff291349299db56e09aacb6b03, scope.project.id=e34048dd48a040f6a440874e3945569f, user.id=cc99489aa0e14928871b6f7b2c955068) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:59.136093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852068ed-cddc-4360-8250-f6786bf59d02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:59.137561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852068ed-cddc-4360-8250-f6786bf59d02 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:59.143742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 648/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 31 11:24:58 2022] GET /identity/v3/role_assignments?user.id=cc99489aa0e14928871b6f7b2c955068&scope.project.id=e34048dd48a040f6a440874e3945569f&role.id=946af2ff291349299db56e09aacb6b03 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:25:01.063185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc59c7-c415-4213-9f69-36576a1b0a73 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:01.063716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc59c7-c415-4213-9f69-36576a1b0a73 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:01.063716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc59c7-c415-4213-9f69-36576a1b0a73 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:01.065041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 640/1288] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:25:01.070023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf1f8d-f6e0-413f-8000-4f520e0c1054 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:01.070475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf1f8d-f6e0-413f-8000-4f520e0c1054 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:01.070578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf1f8d-f6e0-413f-8000-4f520e0c1054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:01.088696 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0adf1f8d-f6e0-413f-8000-4f520e0c1054 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:25:01.089853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0adf1f8d-f6e0-413f-8000-4f520e0c1054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:01.118778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:01.155333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 649/1289] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:25:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:25:01.424826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc59c7-c415-4213-9f69-36576a1b0a73 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:01.524227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc59c7-c415-4213-9f69-36576a1b0a73 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:01.534783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:01.557475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531641d1-0d92-443a-956a-b7a4dd5ec18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:01.558080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531641d1-0d92-443a-956a-b7a4dd5ec18c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:01.558354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531641d1-0d92-443a-956a-b7a4dd5ec18c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:01.558621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531641d1-0d92-443a-956a-b7a4dd5ec18c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:01.559222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531641d1-0d92-443a-956a-b7a4dd5ec18c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:01.561242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531641d1-0d92-443a-956a-b7a4dd5ec18c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-531641d1-0d92-443a-956a-b7a4dd5ec18c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:25:01.569719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:25:01.570978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:25:01.572020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 641/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:25:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:25:01.577281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf1f8d-f6e0-413f-8000-4f520e0c1054 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:01.672214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf1f8d-f6e0-413f-8000-4f520e0c1054 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:01.706765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a050b8-28b2-4ef0-b94d-0d3499514545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:01.707310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a050b8-28b2-4ef0-b94d-0d3499514545 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:01.707590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a050b8-28b2-4ef0-b94d-0d3499514545 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:01.707860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a050b8-28b2-4ef0-b94d-0d3499514545 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:01.708488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a050b8-28b2-4ef0-b94d-0d3499514545 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:25:01.708789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a050b8-28b2-4ef0-b94d-0d3499514545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:01.710160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a050b8-28b2-4ef0-b94d-0d3499514545 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:01.714855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 650/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 31 11:25:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:25:01.720868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531641d1-0d92-443a-956a-b7a4dd5ec18c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:01.819471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531641d1-0d92-443a-956a-b7a4dd5ec18c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:01.850985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac78b1-5555-439c-a050-0c52f69afd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:01.851568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac78b1-5555-439c-a050-0c52f69afd49 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:01.852098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac78b1-5555-439c-a050-0c52f69afd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:01.852379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac78b1-5555-439c-a050-0c52f69afd49 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:01.852977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac78b1-5555-439c-a050-0c52f69afd49 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:25:01.853271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac78b1-5555-439c-a050-0c52f69afd49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:01.854624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac78b1-5555-439c-a050-0c52f69afd49 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:01.859399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 642/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 31 11:25:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:25:03.749262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c935f-66cd-49bb-88e9-eba5aeaf52ee None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:03.749800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c935f-66cd-49bb-88e9-eba5aeaf52ee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:03.749800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c935f-66cd-49bb-88e9-eba5aeaf52ee None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:03.751174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 651/1293] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:25:03.756287 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d3389-776f-4a81-8349-a8581f710b10 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:03.756687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d3389-776f-4a81-8349-a8581f710b10 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:03.756838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d3389-776f-4a81-8349-a8581f710b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:03.775313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e38d3389-776f-4a81-8349-a8581f710b10 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:25:03.776489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e38d3389-776f-4a81-8349-a8581f710b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:03.804559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:03.843638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 643/1294] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:25:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:25:04.128123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c935f-66cd-49bb-88e9-eba5aeaf52ee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:04.160335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:04.229425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c935f-66cd-49bb-88e9-eba5aeaf52ee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:04.263276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef2f6e-35cd-4481-b850-dee3ffdaad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:04.264010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef2f6e-35cd-4481-b850-dee3ffdaad8d None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:04.264290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef2f6e-35cd-4481-b850-dee3ffdaad8d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:04.264564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef2f6e-35cd-4481-b850-dee3ffdaad8d None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:04.265207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef2f6e-35cd-4481-b850-dee3ffdaad8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:04.266615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef2f6e-35cd-4481-b850-dee3ffdaad8d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:04.280375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 652/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 31 11:25:04 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:25:06.167605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed521cc-797e-4853-9e8f-c520ad57e8a7 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:06.168168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed521cc-797e-4853-9e8f-c520ad57e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:06.168168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed521cc-797e-4853-9e8f-c520ad57e8a7 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:06.169536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 644/1296] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:25:06.174654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aa934-abd3-427f-bad8-8a7cdeb1f138 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:06.175052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aa934-abd3-427f-bad8-8a7cdeb1f138 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:06.175225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aa934-abd3-427f-bad8-8a7cdeb1f138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:06.193693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2c9aa934-abd3-427f-bad8-8a7cdeb1f138 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:25:06.194897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2c9aa934-abd3-427f-bad8-8a7cdeb1f138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:06.265398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 653/1297] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:25:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:25:06.531253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed521cc-797e-4853-9e8f-c520ad57e8a7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:06.629447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed521cc-797e-4853-9e8f-c520ad57e8a7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:06.661992 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d635-20a1-406d-920f-f88ccaa0df74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:06.662596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d635-20a1-406d-920f-f88ccaa0df74 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:06.662904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d635-20a1-406d-920f-f88ccaa0df74 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:06.663174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d635-20a1-406d-920f-f88ccaa0df74 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:06.663748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38d635-20a1-406d-920f-f88ccaa0df74 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:06.665099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38d635-20a1-406d-920f-f88ccaa0df74 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-1a38d635-20a1-406d-920f-f88ccaa0df74 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:25:06.674490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:25:06.675683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:25:06.676725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 645/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:25:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:25:06.681540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9aa934-abd3-427f-bad8-8a7cdeb1f138 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:06.699493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:06.778387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9aa934-abd3-427f-bad8-8a7cdeb1f138 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:06.812213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8509-74ae-41b5-9cc6-5dc2237a012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:06.812748 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8509-74ae-41b5-9cc6-5dc2237a012b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:06.813027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8509-74ae-41b5-9cc6-5dc2237a012b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:06.813299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8509-74ae-41b5-9cc6-5dc2237a012b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:06.813926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8509-74ae-41b5-9cc6-5dc2237a012b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:25:06.814226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8509-74ae-41b5-9cc6-5dc2237a012b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:06.815626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8509-74ae-41b5-9cc6-5dc2237a012b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:06.820569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 654/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 31 11:25:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:25:06.826587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d635-20a1-406d-920f-f88ccaa0df74 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:06.858434 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:06.924876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d635-20a1-406d-920f-f88ccaa0df74 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:06.956948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bf462-0ca0-4ceb-8547-5381efc46935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:06.957532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bf462-0ca0-4ceb-8547-5381efc46935 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:06.957809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bf462-0ca0-4ceb-8547-5381efc46935 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:06.958078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bf462-0ca0-4ceb-8547-5381efc46935 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:06.958789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bf462-0ca0-4ceb-8547-5381efc46935 None admin] RBAC: Adding query filter params (interface=public, service_id=63533511333044d5bbef5b0bc711b8e6, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:25:06.959094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bf462-0ca0-4ceb-8547-5381efc46935 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:06.960441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bf462-0ca0-4ceb-8547-5381efc46935 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:06.965206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 646/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 31 11:25:06 2022] GET /identity/v3/endpoints?service_id=63533511333044d5bbef5b0bc711b8e6&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:25:06.971523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8509-74ae-41b5-9cc6-5dc2237a012b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:07.057983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:07.081005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8509-74ae-41b5-9cc6-5dc2237a012b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:07.119017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3bcdf-7d1e-4d0f-b46f-4e09cc4c38c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:07.119616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3bcdf-7d1e-4d0f-b46f-4e09cc4c38c7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:07.119894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3bcdf-7d1e-4d0f-b46f-4e09cc4c38c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:07.120163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3bcdf-7d1e-4d0f-b46f-4e09cc4c38c7 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:07.120764 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3bcdf-7d1e-4d0f-b46f-4e09cc4c38c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:07.122134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3bcdf-7d1e-4d0f-b46f-4e09cc4c38c7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:07.128963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 655/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 31 11:25:06 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:25:09.008952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d59b9-aebf-4e76-ab73-6dbce398b267 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:09.009466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d59b9-aebf-4e76-ab73-6dbce398b267 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:09.009582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d59b9-aebf-4e76-ab73-6dbce398b267 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:09.010851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 647/1302] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:25:09.016554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46dd79-a4d6-4c50-a722-496044e04b7d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:09.017009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46dd79-a4d6-4c50-a722-496044e04b7d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:09.017116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46dd79-a4d6-4c50-a722-496044e04b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:09.035957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cc46dd79-a4d6-4c50-a722-496044e04b7d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:25:09.037173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cc46dd79-a4d6-4c50-a722-496044e04b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:09.103059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 656/1303] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:25:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:25:09.369620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d59b9-aebf-4e76-ab73-6dbce398b267 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:09.462347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:09.469538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d59b9-aebf-4e76-ab73-6dbce398b267 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:09.503817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f62e5c-5cc6-42e5-a625-f8439a8a1725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:09.504435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62e5c-5cc6-42e5-a625-f8439a8a1725 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:09.504716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62e5c-5cc6-42e5-a625-f8439a8a1725 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:09.504991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62e5c-5cc6-42e5-a625-f8439a8a1725 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:09.505569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f62e5c-5cc6-42e5-a625-f8439a8a1725 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:09.506964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f62e5c-5cc6-42e5-a625-f8439a8a1725 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-42f62e5c-5cc6-42e5-a625-f8439a8a1725 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:25:09.515633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:25:09.516799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Aug 31 11:25:09.517734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 648/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 31 11:25:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:25:09.523379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46dd79-a4d6-4c50-a722-496044e04b7d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:09.599155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:09.623618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46dd79-a4d6-4c50-a722-496044e04b7d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:09.656533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c3056-3dd3-40be-a6d5-7eb98a0841ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:09.657124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3056-3dd3-40be-a6d5-7eb98a0841ad None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:09.657401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3056-3dd3-40be-a6d5-7eb98a0841ad None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:09.657669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3056-3dd3-40be-a6d5-7eb98a0841ad None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:09.658289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c3056-3dd3-40be-a6d5-7eb98a0841ad None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:25:09.658584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c3056-3dd3-40be-a6d5-7eb98a0841ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:09.659974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c3056-3dd3-40be-a6d5-7eb98a0841ad None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:09.664869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 657/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 31 11:25:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:25:09.671780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f62e5c-5cc6-42e5-a625-f8439a8a1725 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:09.768397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f62e5c-5cc6-42e5-a625-f8439a8a1725 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:09.801007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2d3fc-fe13-400b-a2a2-4499e0e8f159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:09.801595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d3fc-fe13-400b-a2a2-4499e0e8f159 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:09.801869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d3fc-fe13-400b-a2a2-4499e0e8f159 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:09.802137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d3fc-fe13-400b-a2a2-4499e0e8f159 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:09.802828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2d3fc-fe13-400b-a2a2-4499e0e8f159 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:09.804171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2d3fc-fe13-400b-a2a2-4499e0e8f159 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:09.822755 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 649/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:25:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:25:19.662288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=30 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:19.818592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:13.453558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fee0f-dbce-40f8-ae41-d9117f2c5a3c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:13.454620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fee0f-dbce-40f8-ae41-d9117f2c5a3c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:13.455160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fee0f-dbce-40f8-ae41-d9117f2c5a3c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:13.461833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75c8f-2433-4bce-ac1a-4a2e5657cae2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:13.462693 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75c8f-2433-4bce-ac1a-4a2e5657cae2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:13.463541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75c8f-2433-4bce-ac1a-4a2e5657cae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:13.467088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 658/1307] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:13.552649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-56f75c8f-2433-4bce-ac1a-4a2e5657cae2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:13.554208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-56f75c8f-2433-4bce-ac1a-4a2e5657cae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:13.719581 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 650/1308] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:26:14.071146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f68707-8e41-45c1-98e3-da748b665446 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:14.071920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f68707-8e41-45c1-98e3-da748b665446 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:14.072451 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f68707-8e41-45c1-98e3-da748b665446 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:14.074493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 659/1309] 10.222.0.64 () {54 vars in 965 bytes} [Wed Aug 31 11:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:14.082438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddcf56-1b27-4976-a968-4d6369d0b4ba None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:14.083091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddcf56-1b27-4976-a968-4d6369d0b4ba None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:14.083662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddcf56-1b27-4976-a968-4d6369d0b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:14.174574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-43ddcf56-1b27-4976-a968-4d6369d0b4ba None None] MFA Rules not processed for user `e0f654bfe8364490a322b88433dd8fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:14.176298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-43ddcf56-1b27-4976-a968-4d6369d0b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:14.201155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:14.275856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f68707-8e41-45c1-98e3-da748b665446 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:14.278028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a6f68707-8e41-45c1-98e3-da748b665446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:14.286709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 651/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Aug 31 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:14.399089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f68707-8e41-45c1-98e3-da748b665446 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:14.501796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e45a4-b414-4f67-927c-42c7f4b91839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:14.503305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e45a4-b414-4f67-927c-42c7f4b91839 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:14.503738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e45a4-b414-4f67-927c-42c7f4b91839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:14.504187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e45a4-b414-4f67-927c-42c7f4b91839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:14.506003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ee2e45a4-b414-4f67-927c-42c7f4b91839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:14.579349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:14.646967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e45a4-b414-4f67-927c-42c7f4b91839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:14.648505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e45a4-b414-4f67-927c-42c7f4b91839 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:14.677709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 660/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:26:16.991028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964534a6-b146-4b0a-84ff-c8172a4451a5 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:16.991576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964534a6-b146-4b0a-84ff-c8172a4451a5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:16.991576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964534a6-b146-4b0a-84ff-c8172a4451a5 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:16.992929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 652/1312] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:16.998648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e18e2-e4f3-4063-b5ae-5b29b906d1d4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:16.999188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e18e2-e4f3-4063-b5ae-5b29b906d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:16.999286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e18e2-e4f3-4063-b5ae-5b29b906d1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:17.077434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7f4e18e2-e4f3-4063-b5ae-5b29b906d1d4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:17.078650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7f4e18e2-e4f3-4063-b5ae-5b29b906d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:17.176369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 661/1313] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:26:17.469045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964534a6-b146-4b0a-84ff-c8172a4451a5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:17.470575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-964534a6-b146-4b0a-84ff-c8172a4451a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:17.571754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964534a6-b146-4b0a-84ff-c8172a4451a5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:17.640715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:17.643437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a13e80-7250-4b25-aff4-3aa67e5caf25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:17.644261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13e80-7250-4b25-aff4-3aa67e5caf25 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:17.644706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13e80-7250-4b25-aff4-3aa67e5caf25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:17.645174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13e80-7250-4b25-aff4-3aa67e5caf25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:17.646829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a9a13e80-7250-4b25-aff4-3aa67e5caf25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:17.754971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13e80-7250-4b25-aff4-3aa67e5caf25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:17.756401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13e80-7250-4b25-aff4-3aa67e5caf25 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:17.773775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 653/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:19.973330 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5289d57-52b6-4b85-81c0-384ed1adc529 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:19.973846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5289d57-52b6-4b85-81c0-384ed1adc529 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:19.973846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5289d57-52b6-4b85-81c0-384ed1adc529 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:19.975206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 662/1315] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:19.980438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aaeea-5919-4603-b5ea-a45af9541d2f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:19.980851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aaeea-5919-4603-b5ea-a45af9541d2f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:19.980983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aaeea-5919-4603-b5ea-a45af9541d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:20.046037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-054aaeea-5919-4603-b5ea-a45af9541d2f None None] MFA Rules not processed for user `b91fb1c4eb2941b8b5dbc452aa5dd9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:20.047292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-054aaeea-5919-4603-b5ea-a45af9541d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:20.098283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:20.143677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 654/1316] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:20.427948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5289d57-52b6-4b85-81c0-384ed1adc529 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:20.429490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f5289d57-52b6-4b85-81c0-384ed1adc529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:20.439301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:20.531734 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5289d57-52b6-4b85-81c0-384ed1adc529 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:20.604529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac29e9-6086-48e8-8f9f-f0950cedfcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:20.605126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac29e9-6086-48e8-8f9f-f0950cedfcca service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:20.605405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac29e9-6086-48e8-8f9f-f0950cedfcca service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:20.605676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac29e9-6086-48e8-8f9f-f0950cedfcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:20.607427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ebac29e9-6086-48e8-8f9f-f0950cedfcca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:20.669415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:20.718104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac29e9-6086-48e8-8f9f-f0950cedfcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:20.719514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac29e9-6086-48e8-8f9f-f0950cedfcca service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:20.737412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 663/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:23.203615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022c5e-7282-4eef-a3e0-6267405409d4 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:23.204459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022c5e-7282-4eef-a3e0-6267405409d4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:23.204459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022c5e-7282-4eef-a3e0-6267405409d4 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:23.205958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 655/1318] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:23.211309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e574e-2dcc-468b-bba4-0cfaf34e10a9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:23.211774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e574e-2dcc-468b-bba4-0cfaf34e10a9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:23.211895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e574e-2dcc-468b-bba4-0cfaf34e10a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:23.286947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8c4e574e-2dcc-468b-bba4-0cfaf34e10a9 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:23.288148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8c4e574e-2dcc-468b-bba4-0cfaf34e10a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:23.399806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 664/1319] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:23.724057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022c5e-7282-4eef-a3e0-6267405409d4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:23.725599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4f022c5e-7282-4eef-a3e0-6267405409d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:23.843776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022c5e-7282-4eef-a3e0-6267405409d4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:23.928826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136581c-6494-42f4-8c8a-81fb7b029c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:23.929338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136581c-6494-42f4-8c8a-81fb7b029c05 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:23.929613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136581c-6494-42f4-8c8a-81fb7b029c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:23.929881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136581c-6494-42f4-8c8a-81fb7b029c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:23.931498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c136581c-6494-42f4-8c8a-81fb7b029c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:23.939554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:24.046654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136581c-6494-42f4-8c8a-81fb7b029c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:24.048112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136581c-6494-42f4-8c8a-81fb7b029c05 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:24.065854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 656/1320] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:26:26.621780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719006e-cf9b-4644-b6a5-e74942d4fedd None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:26.622363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719006e-cf9b-4644-b6a5-e74942d4fedd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:26.622515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719006e-cf9b-4644-b6a5-e74942d4fedd None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:26.624035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 665/1321] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:26.629325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46935f75-8cb0-4b0c-9a57-763ae28f96a4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:26.629766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46935f75-8cb0-4b0c-9a57-763ae28f96a4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:26.629876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46935f75-8cb0-4b0c-9a57-763ae28f96a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:26.701988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-46935f75-8cb0-4b0c-9a57-763ae28f96a4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:26.703290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-46935f75-8cb0-4b0c-9a57-763ae28f96a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:26.759880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:26.801097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 657/1322] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:27.086971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719006e-cf9b-4644-b6a5-e74942d4fedd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:27.088512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f719006e-cf9b-4644-b6a5-e74942d4fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:27.108196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:27.194655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719006e-cf9b-4644-b6a5-e74942d4fedd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:27.267958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2aa9e5-0f82-4652-acf9-8e834740766a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:27.268553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2aa9e5-0f82-4652-acf9-8e834740766a service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:27.268823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2aa9e5-0f82-4652-acf9-8e834740766a service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:27.269120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2aa9e5-0f82-4652-acf9-8e834740766a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:27.270775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bd2aa9e5-0f82-4652-acf9-8e834740766a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:27.342376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:27.383158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2aa9e5-0f82-4652-acf9-8e834740766a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:27.384621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2aa9e5-0f82-4652-acf9-8e834740766a service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:27.403316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 666/1323] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:29.379019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e9e4f-0066-4011-803e-9d9649652b89 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:29.379529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e9e4f-0066-4011-803e-9d9649652b89 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:29.379529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e9e4f-0066-4011-803e-9d9649652b89 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:29.381054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 658/1324] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:29.386244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13e347-c016-464e-b74a-f9dcdee1ee87 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:29.386709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13e347-c016-464e-b74a-f9dcdee1ee87 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:29.386933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13e347-c016-464e-b74a-f9dcdee1ee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:29.453807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-da13e347-c016-464e-b74a-f9dcdee1ee87 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:29.455053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-da13e347-c016-464e-b74a-f9dcdee1ee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:29.552119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 667/1325] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:29.839839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e9e4f-0066-4011-803e-9d9649652b89 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:29.843146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-524e9e4f-0066-4011-803e-9d9649652b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:29.949754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e9e4f-0066-4011-803e-9d9649652b89 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:30.034563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c69cb-4b01-4b42-bd7d-10c246630739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:30.035194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c69cb-4b01-4b42-bd7d-10c246630739 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:30.035472 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c69cb-4b01-4b42-bd7d-10c246630739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:30.035736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c69cb-4b01-4b42-bd7d-10c246630739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:30.037320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-062c69cb-4b01-4b42-bd7d-10c246630739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:30.054968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:30.148969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c69cb-4b01-4b42-bd7d-10c246630739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:30.150414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c69cb-4b01-4b42-bd7d-10c246630739 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:30.168602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 659/1326] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:26:32.165290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6aafd2-d986-4ee9-8e45-d53e9537a16a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:32.165911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6aafd2-d986-4ee9-8e45-d53e9537a16a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:32.165911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6aafd2-d986-4ee9-8e45-d53e9537a16a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:32.167278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 668/1327] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:32.173850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f93f2-6fcd-4566-a5a5-51454a78f21a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:32.174419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f93f2-6fcd-4566-a5a5-51454a78f21a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:32.174419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f93f2-6fcd-4566-a5a5-51454a78f21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:32.242450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cd6f93f2-6fcd-4566-a5a5-51454a78f21a None None] MFA Rules not processed for user `b91fb1c4eb2941b8b5dbc452aa5dd9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:32.243693 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cd6f93f2-6fcd-4566-a5a5-51454a78f21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:32.307683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:32.339524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 660/1328] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:32.623622 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6aafd2-d986-4ee9-8e45-d53e9537a16a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:32.625149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a6aafd2-d986-4ee9-8e45-d53e9537a16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:32.660527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:32.735213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6aafd2-d986-4ee9-8e45-d53e9537a16a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:32.808478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d3ee-bb9d-40a0-b4ba-e05f8d9d21fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:32.809011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d3ee-bb9d-40a0-b4ba-e05f8d9d21fb service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:32.809315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d3ee-bb9d-40a0-b4ba-e05f8d9d21fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:32.809809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d3ee-bb9d-40a0-b4ba-e05f8d9d21fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:32.811496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-43d1d3ee-bb9d-40a0-b4ba-e05f8d9d21fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:32.890716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:32.923372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1d3ee-bb9d-40a0-b4ba-e05f8d9d21fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:32.924829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1d3ee-bb9d-40a0-b4ba-e05f8d9d21fb service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:32.943002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 669/1329] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:35.115806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2f30-22f1-43c1-ba5e-7c69a2936c2b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:35.116356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2f30-22f1-43c1-ba5e-7c69a2936c2b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:35.116356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2f30-22f1-43c1-ba5e-7c69a2936c2b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:35.117684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 661/1330] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:35.123439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d18fe-64af-487f-8aa9-490a1f1c63ea None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:35.123853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d18fe-64af-487f-8aa9-490a1f1c63ea None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:35.123967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d18fe-64af-487f-8aa9-490a1f1c63ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:35.191204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b56d18fe-64af-487f-8aa9-490a1f1c63ea None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:35.192480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b56d18fe-64af-487f-8aa9-490a1f1c63ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:35.289430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 670/1331] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:35.572085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f2f30-22f1-43c1-ba5e-7c69a2936c2b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:35.573606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-aa0f2f30-22f1-43c1-ba5e-7c69a2936c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:35.677228 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f2f30-22f1-43c1-ba5e-7c69a2936c2b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:35.750655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7881720-2324-4a69-bc37-b58cfa6b23cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:35.751278 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881720-2324-4a69-bc37-b58cfa6b23cb service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:35.751553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881720-2324-4a69-bc37-b58cfa6b23cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:35.751821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881720-2324-4a69-bc37-b58cfa6b23cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:35.753400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e7881720-2324-4a69-bc37-b58cfa6b23cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:35.779037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:35.860183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7881720-2324-4a69-bc37-b58cfa6b23cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:35.861599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7881720-2324-4a69-bc37-b58cfa6b23cb service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:35.879951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 662/1332] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:37.880579 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03313878-3434-4de6-b23a-6bfd06aca5c7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:37.881155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03313878-3434-4de6-b23a-6bfd06aca5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:37.881155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03313878-3434-4de6-b23a-6bfd06aca5c7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:37.882507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 671/1333] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:37.887705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a6af-aea7-417f-8825-4f7e2f9ef30c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:37.890724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a6af-aea7-417f-8825-4f7e2f9ef30c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:37.890724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a6af-aea7-417f-8825-4f7e2f9ef30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:37.952353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d720a6af-aea7-417f-8825-4f7e2f9ef30c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:37.953462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d720a6af-aea7-417f-8825-4f7e2f9ef30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:38.025988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:38.057362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 663/1334] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:38.345999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03313878-3434-4de6-b23a-6bfd06aca5c7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:38.347550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-03313878-3434-4de6-b23a-6bfd06aca5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:38.388052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:38.452028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03313878-3434-4de6-b23a-6bfd06aca5c7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:38.524955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3412e-7315-4f13-a76e-8d8b79e9ae06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:38.525549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3412e-7315-4f13-a76e-8d8b79e9ae06 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:38.525830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3412e-7315-4f13-a76e-8d8b79e9ae06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:38.526106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3412e-7315-4f13-a76e-8d8b79e9ae06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:38.527737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cac3412e-7315-4f13-a76e-8d8b79e9ae06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:38.612067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:38.638527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3412e-7315-4f13-a76e-8d8b79e9ae06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:38.640007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3412e-7315-4f13-a76e-8d8b79e9ae06 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:38.657779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 672/1335] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:40.849603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba4ab9-ffa6-4b36-8d25-7b5627785147 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:40.850174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba4ab9-ffa6-4b36-8d25-7b5627785147 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:40.850174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba4ab9-ffa6-4b36-8d25-7b5627785147 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:40.851502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 664/1336] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:40.857320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bed53-73a9-44c3-89d2-2155d9b39b7c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:40.857772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bed53-73a9-44c3-89d2-2155d9b39b7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:40.857869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bed53-73a9-44c3-89d2-2155d9b39b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:40.924264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9d3bed53-73a9-44c3-89d2-2155d9b39b7c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:40.925376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9d3bed53-73a9-44c3-89d2-2155d9b39b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:41.022156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 673/1337] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:41.320594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba4ab9-ffa6-4b36-8d25-7b5627785147 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:41.322160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c0ba4ab9-ffa6-4b36-8d25-7b5627785147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:41.424009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba4ab9-ffa6-4b36-8d25-7b5627785147 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:41.494724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840c20a-fb62-4df3-8a56-0063a201278e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:41.495318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c20a-fb62-4df3-8a56-0063a201278e service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:41.495595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c20a-fb62-4df3-8a56-0063a201278e service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:41.495865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c20a-fb62-4df3-8a56-0063a201278e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:41.497654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c840c20a-fb62-4df3-8a56-0063a201278e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:41.532245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:41.604155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840c20a-fb62-4df3-8a56-0063a201278e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:41.605778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840c20a-fb62-4df3-8a56-0063a201278e service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:41.625724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 665/1338] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:45.434142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9d606-95bb-431b-a7b0-a0f0961d397d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:45.434612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9d606-95bb-431b-a7b0-a0f0961d397d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:45.434791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9d606-95bb-431b-a7b0-a0f0961d397d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:45.436169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 674/1339] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:45.441611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f37b-622e-4fa8-8a2c-f304c145fadf None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:45.442033 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f37b-622e-4fa8-8a2c-f304c145fadf None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:45.442151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f37b-622e-4fa8-8a2c-f304c145fadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:45.508295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f208f37b-622e-4fa8-8a2c-f304c145fadf None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:45.509512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f208f37b-622e-4fa8-8a2c-f304c145fadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:45.596552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:45.608953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 666/1340] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:45.891522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9d606-95bb-431b-a7b0-a0f0961d397d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:45.893052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fca9d606-95bb-431b-a7b0-a0f0961d397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:45.943968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:45.999738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9d606-95bb-431b-a7b0-a0f0961d397d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:46.076373 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01015900-3f5e-41bb-9ea0-8845fc1a07ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:46.076980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015900-3f5e-41bb-9ea0-8845fc1a07ea service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:46.077261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015900-3f5e-41bb-9ea0-8845fc1a07ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:46.077534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015900-3f5e-41bb-9ea0-8845fc1a07ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:46.079172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-01015900-3f5e-41bb-9ea0-8845fc1a07ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:46.176350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:46.192846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01015900-3f5e-41bb-9ea0-8845fc1a07ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:46.194315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01015900-3f5e-41bb-9ea0-8845fc1a07ea service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:46.213691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 675/1341] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:26:48.785045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ced9-0c61-4021-b0fe-00b461acaa54 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:48.785498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ced9-0c61-4021-b0fe-00b461acaa54 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:48.785742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ced9-0c61-4021-b0fe-00b461acaa54 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:48.786962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 667/1342] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:48.792226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f654b46-d3f3-4bce-91bb-2d8d38d9c68b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:48.792671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f654b46-d3f3-4bce-91bb-2d8d38d9c68b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:48.792807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f654b46-d3f3-4bce-91bb-2d8d38d9c68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:48.862578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3f654b46-d3f3-4bce-91bb-2d8d38d9c68b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:48.863823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3f654b46-d3f3-4bce-91bb-2d8d38d9c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:48.961016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 676/1343] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:49.253106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ced9-0c61-4021-b0fe-00b461acaa54 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:49.254654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-83e2ced9-0c61-4021-b0fe-00b461acaa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:49.358418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ced9-0c61-4021-b0fe-00b461acaa54 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:49.432998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836814db-44ce-4417-b6a5-19fe67684c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:49.433610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836814db-44ce-4417-b6a5-19fe67684c17 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:49.433893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836814db-44ce-4417-b6a5-19fe67684c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:49.434715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836814db-44ce-4417-b6a5-19fe67684c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:49.436504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-836814db-44ce-4417-b6a5-19fe67684c17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:49.486158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:49.552664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836814db-44ce-4417-b6a5-19fe67684c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:49.554266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836814db-44ce-4417-b6a5-19fe67684c17 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:49.572672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 668/1344] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:53.480083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300d05-1cfd-46e7-9adf-47f3aa39db5a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:53.480752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300d05-1cfd-46e7-9adf-47f3aa39db5a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:53.480895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300d05-1cfd-46e7-9adf-47f3aa39db5a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:53.482461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 677/1345] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:53.488224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020fc9a-9e00-480b-97a6-394c03570d12 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:53.488719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020fc9a-9e00-480b-97a6-394c03570d12 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:53.488840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020fc9a-9e00-480b-97a6-394c03570d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:53.568747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8020fc9a-9e00-480b-97a6-394c03570d12 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:53.569993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8020fc9a-9e00-480b-97a6-394c03570d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:53.676939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:53.690164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 669/1346] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:53.966302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65300d05-1cfd-46e7-9adf-47f3aa39db5a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:53.967900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-65300d05-1cfd-46e7-9adf-47f3aa39db5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:54.028480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:54.080692 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65300d05-1cfd-46e7-9adf-47f3aa39db5a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:54.156490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b048-81e5-40f5-84a0-1b9e379a4916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:54.157113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b048-81e5-40f5-84a0-1b9e379a4916 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:54.157388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b048-81e5-40f5-84a0-1b9e379a4916 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:54.157654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b048-81e5-40f5-84a0-1b9e379a4916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:54.159263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d956b048-81e5-40f5-84a0-1b9e379a4916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:54.264809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:54.268713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b048-81e5-40f5-84a0-1b9e379a4916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:54.270339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b048-81e5-40f5-84a0-1b9e379a4916 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:54.288628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 678/1347] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:59.186186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb4309-c760-4115-a7e2-7248ebc0feb8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:59.186794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb4309-c760-4115-a7e2-7248ebc0feb8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:59.186794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb4309-c760-4115-a7e2-7248ebc0feb8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:59.188456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 670/1348] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:26:59.193375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750da3-f042-470d-898e-e7d72f57e937 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:59.194160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750da3-f042-470d-898e-e7d72f57e937 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:59.194632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750da3-f042-470d-898e-e7d72f57e937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:59.291064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d3750da3-f042-470d-898e-e7d72f57e937 None None] MFA Rules not processed for user `cc99489aa0e14928871b6f7b2c955068`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:59.292851 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d3750da3-f042-470d-898e-e7d72f57e937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:59.447730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 679/1349] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:03.583680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582267-ab84-4ed7-b2de-b2326b0605cb None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:03.584236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582267-ab84-4ed7-b2de-b2326b0605cb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:03.584236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582267-ab84-4ed7-b2de-b2326b0605cb None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:03.585630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 671/1350] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:03.590444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4579e1e-ce73-4f71-b66d-415c8b513c53 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:03.591013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4579e1e-ce73-4f71-b66d-415c8b513c53 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:03.591105 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4579e1e-ce73-4f71-b66d-415c8b513c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:03.648889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:03.676666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d4579e1e-ce73-4f71-b66d-415c8b513c53 None None] MFA Rules not processed for user `cc99489aa0e14928871b6f7b2c955068`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:03.678138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d4579e1e-ce73-4f71-b66d-415c8b513c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:03.792917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 680/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:27:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:05.242209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a717a8a-cc1a-4b7c-aab1-a169266bf6d7 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:05.242798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a717a8a-cc1a-4b7c-aab1-a169266bf6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:05.242964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a717a8a-cc1a-4b7c-aab1-a169266bf6d7 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:05.244437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 672/1352] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:05.250297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ca31-482c-4146-b3b0-9aecba44d1d1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:05.250778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ca31-482c-4146-b3b0-9aecba44d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:05.250947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ca31-482c-4146-b3b0-9aecba44d1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:05.330608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2b52ca31-482c-4146-b3b0-9aecba44d1d1 None None] MFA Rules not processed for user `cc99489aa0e14928871b6f7b2c955068`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:05.332553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b52ca31-482c-4146-b3b0-9aecba44d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:05.375517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:05.439924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 681/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:27:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:08.800988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfec19-5baa-4e69-bdd5-a5016a4c4301 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:08.800988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfec19-5baa-4e69-bdd5-a5016a4c4301 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:08.801478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfec19-5baa-4e69-bdd5-a5016a4c4301 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:08.802537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 673/1354] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:08.808116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2505696-1e49-4888-ab81-7589afbc7a8a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:08.808579 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2505696-1e49-4888-ab81-7589afbc7a8a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:08.808698 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2505696-1e49-4888-ab81-7589afbc7a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:08.897827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e2505696-1e49-4888-ab81-7589afbc7a8a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:08.899957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e2505696-1e49-4888-ab81-7589afbc7a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:09.020813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 682/1355] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:09.326648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9cd21-9ec1-4c27-ad6f-25427f8e86d0 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:09.327580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9cd21-9ec1-4c27-ad6f-25427f8e86d0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:09.328184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9cd21-9ec1-4c27-ad6f-25427f8e86d0 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:09.331569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 674/1356] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 31 11:27:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:09.341335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa817-2c58-41c3-b708-b68da2736910 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:09.342202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa817-2c58-41c3-b708-b68da2736910 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:09.342645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa817-2c58-41c3-b708-b68da2736910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:09.363282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:09.428980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e3ffa817-2c58-41c3-b708-b68da2736910 None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:09.430174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e3ffa817-2c58-41c3-b708-b68da2736910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:09.563688 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 683/1357] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 31 11:27:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:09.572027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9cd21-9ec1-4c27-ad6f-25427f8e86d0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:09.573667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8ac9cd21-9ec1-4c27-ad6f-25427f8e86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:09.727660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9cd21-9ec1-4c27-ad6f-25427f8e86d0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:09.804622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:09.847278 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4945ab-6f20-4a66-9f6c-395035a63e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:09.847776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4945ab-6f20-4a66-9f6c-395035a63e9d service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:09.848047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4945ab-6f20-4a66-9f6c-395035a63e9d service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:09.848312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4945ab-6f20-4a66-9f6c-395035a63e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:09.849876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3c4945ab-6f20-4a66-9f6c-395035a63e9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:09.942043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4945ab-6f20-4a66-9f6c-395035a63e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:09.943779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4945ab-6f20-4a66-9f6c-395035a63e9d service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:09.962710 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 675/1358] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:27:12.100488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d332f7-369b-443d-8bce-16796033392b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:12.101075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d332f7-369b-443d-8bce-16796033392b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:12.101075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d332f7-369b-443d-8bce-16796033392b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:12.102612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 684/1359] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:27:12.108198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f201e-7ab3-42bf-97b0-c64a05765539 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:12.108767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f201e-7ab3-42bf-97b0-c64a05765539 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:12.108767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f201e-7ab3-42bf-97b0-c64a05765539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:12.187079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9f1f201e-7ab3-42bf-97b0-c64a05765539 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:12.188391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9f1f201e-7ab3-42bf-97b0-c64a05765539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:12.228767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:12.292498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 676/1360] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:12.596546 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d332f7-369b-443d-8bce-16796033392b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:12.603799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b1d332f7-369b-443d-8bce-16796033392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:12.688595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:12.789207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d332f7-369b-443d-8bce-16796033392b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:12.913589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba9c4b-8b38-4f4a-af88-c76131125644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:12.914281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9c4b-8b38-4f4a-af88-c76131125644 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:12.914660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9c4b-8b38-4f4a-af88-c76131125644 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:12.915059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9c4b-8b38-4f4a-af88-c76131125644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:12.916766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3dba9c4b-8b38-4f4a-af88-c76131125644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:12.941063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:13.017718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba9c4b-8b38-4f4a-af88-c76131125644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:13.019436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba9c4b-8b38-4f4a-af88-c76131125644 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:13.040314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 685/1361] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:15.291580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d702e-bdb5-4b3f-9da5-b84002d4b349 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:15.292477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d702e-bdb5-4b3f-9da5-b84002d4b349 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:15.294025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d702e-bdb5-4b3f-9da5-b84002d4b349 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:15.295426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 677/1362] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:15.301041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab96a2-712c-4e16-b004-4cc1108d47aa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:15.301541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab96a2-712c-4e16-b004-4cc1108d47aa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:15.301648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab96a2-712c-4e16-b004-4cc1108d47aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:15.377657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0aab96a2-712c-4e16-b004-4cc1108d47aa None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:15.379147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0aab96a2-712c-4e16-b004-4cc1108d47aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:15.484265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:15.493523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 686/1363] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:15.789848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f88de-4963-464f-9fd2-b56dafd34a1b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:15.790130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f88de-4963-464f-9fd2-b56dafd34a1b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:15.790582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f88de-4963-464f-9fd2-b56dafd34a1b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:15.792216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 678/1364] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 31 11:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:15.799179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dc833-3cd8-49fd-ad02-c5be603d258a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:15.799991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dc833-3cd8-49fd-ad02-c5be603d258a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:15.800612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dc833-3cd8-49fd-ad02-c5be603d258a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:15.881746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-051dc833-3cd8-49fd-ad02-c5be603d258a None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:15.883312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-051dc833-3cd8-49fd-ad02-c5be603d258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:16.006075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 687/1365] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 31 11:27:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:16.013841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f88de-4963-464f-9fd2-b56dafd34a1b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:16.015548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-271f88de-4963-464f-9fd2-b56dafd34a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:16.174689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f88de-4963-464f-9fd2-b56dafd34a1b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:16.198223 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:16.298731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1953461-6d7a-4af3-98d8-622e2e8f7c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:16.299411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953461-6d7a-4af3-98d8-622e2e8f7c0f service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:16.299514 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953461-6d7a-4af3-98d8-622e2e8f7c0f service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:16.299769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953461-6d7a-4af3-98d8-622e2e8f7c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:16.301359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e1953461-6d7a-4af3-98d8-622e2e8f7c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:16.394611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1953461-6d7a-4af3-98d8-622e2e8f7c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:16.396610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1953461-6d7a-4af3-98d8-622e2e8f7c0f service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:16.415809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 679/1366] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:17.035395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b3284-5230-48b1-80c0-bcf4bff15eda None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:17.035933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b3284-5230-48b1-80c0-bcf4bff15eda None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:17.035933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b3284-5230-48b1-80c0-bcf4bff15eda None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:17.037460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 688/1367] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:17.042649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8645a-7404-43f4-b70f-9be909cb40ad None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:17.043146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8645a-7404-43f4-b70f-9be909cb40ad None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:17.044104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8645a-7404-43f4-b70f-9be909cb40ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:17.083173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:17.129163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-00d8645a-7404-43f4-b70f-9be909cb40ad None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:17.130372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-00d8645a-7404-43f4-b70f-9be909cb40ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:17.241701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 680/1368] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:17.791487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac49a4-c45c-4d6e-8dab-4054003c1abf None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:17.791776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac49a4-c45c-4d6e-8dab-4054003c1abf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:17.792055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac49a4-c45c-4d6e-8dab-4054003c1abf None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:17.793804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 689/1369] 10.222.0.64 () {54 vars in 964 bytes} [Wed Aug 31 11:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:17.799037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523db21-5c95-4905-aecd-6375fe5699a0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:17.799506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523db21-5c95-4905-aecd-6375fe5699a0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:17.799597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523db21-5c95-4905-aecd-6375fe5699a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:17.879218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f523db21-5c95-4905-aecd-6375fe5699a0 None None] MFA Rules not processed for user `0f4db8824b7e4ae6880840e3c8680610`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:17.880438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f523db21-5c95-4905-aecd-6375fe5699a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:17.930541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:17.963835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 681/1370] 10.222.0.64 () {58 vars in 1061 bytes} [Wed Aug 31 11:27:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:17.971313 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac49a4-c45c-4d6e-8dab-4054003c1abf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:17.972818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7dac49a4-c45c-4d6e-8dab-4054003c1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:18.033863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:18.090935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac49a4-c45c-4d6e-8dab-4054003c1abf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:18.167776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972608cd-b78e-4f8f-8a2f-8a4035863ce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:18.168526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972608cd-b78e-4f8f-8a2f-8a4035863ce8 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:18.168819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972608cd-b78e-4f8f-8a2f-8a4035863ce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:18.169093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972608cd-b78e-4f8f-8a2f-8a4035863ce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:18.170705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-972608cd-b78e-4f8f-8a2f-8a4035863ce8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:18.281928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:18.301033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972608cd-b78e-4f8f-8a2f-8a4035863ce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:18.302496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972608cd-b78e-4f8f-8a2f-8a4035863ce8 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:18.324235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 690/1371] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:18.428429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cea566-8a32-4995-a5de-167aab70e47d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:18.428751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cea566-8a32-4995-a5de-167aab70e47d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:18.429080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cea566-8a32-4995-a5de-167aab70e47d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:18.430473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 682/1372] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:18.436226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa9bab-90f3-4b96-bcac-4aec9e352231 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:18.436544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa9bab-90f3-4b96-bcac-4aec9e352231 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:18.436774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa9bab-90f3-4b96-bcac-4aec9e352231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:18.507192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-07fa9bab-90f3-4b96-bcac-4aec9e352231 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:18.508425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-07fa9bab-90f3-4b96-bcac-4aec9e352231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:18.645710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 691/1373] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:18.946882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cea566-8a32-4995-a5de-167aab70e47d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:18.948401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-81cea566-8a32-4995-a5de-167aab70e47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:19.113762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cea566-8a32-4995-a5de-167aab70e47d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:19.168288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:19.230268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713f9f8-68db-4e68-8cda-1bb2b77c9012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:19.230863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713f9f8-68db-4e68-8cda-1bb2b77c9012 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:19.231412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713f9f8-68db-4e68-8cda-1bb2b77c9012 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:19.231684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713f9f8-68db-4e68-8cda-1bb2b77c9012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:19.233275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0713f9f8-68db-4e68-8cda-1bb2b77c9012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:19.327262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713f9f8-68db-4e68-8cda-1bb2b77c9012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:19.328832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713f9f8-68db-4e68-8cda-1bb2b77c9012 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:19.347478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 683/1374] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:21.299178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f227-7db8-47d3-bad2-b707b369b7bd None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:21.299690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f227-7db8-47d3-bad2-b707b369b7bd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:21.299809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f227-7db8-47d3-bad2-b707b369b7bd None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:21.301080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 692/1375] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:21.306297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb8f3-7dd1-40c4-b040-cd636a51a778 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:21.306727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb8f3-7dd1-40c4-b040-cd636a51a778 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:21.306874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb8f3-7dd1-40c4-b040-cd636a51a778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:21.377556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e3acb8f3-7dd1-40c4-b040-cd636a51a778 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:21.378804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e3acb8f3-7dd1-40c4-b040-cd636a51a778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:21.387861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:21.491631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 684/1376] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:21.787604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f227-7db8-47d3-bad2-b707b369b7bd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:21.789132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3393f227-7db8-47d3-bad2-b707b369b7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:21.866856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:21.991673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f227-7db8-47d3-bad2-b707b369b7bd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:22.119588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f567fa-ffbf-42a1-9851-ac42c5196383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:22.120379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f567fa-ffbf-42a1-9851-ac42c5196383 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:22.120756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f567fa-ffbf-42a1-9851-ac42c5196383 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:22.121153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f567fa-ffbf-42a1-9851-ac42c5196383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:22.123540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-29f567fa-ffbf-42a1-9851-ac42c5196383 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:22.143371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:22.220427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f567fa-ffbf-42a1-9851-ac42c5196383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:22.222266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f567fa-ffbf-42a1-9851-ac42c5196383 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:22.243037 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 693/1377] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:24.231829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4bb1-201a-4e39-8b1b-fa0e7e88bec4 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:24.232384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4bb1-201a-4e39-8b1b-fa0e7e88bec4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:24.232384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4bb1-201a-4e39-8b1b-fa0e7e88bec4 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:24.233854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 685/1378] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:24.239810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa4446-f0c9-4004-abf9-8ca0ff05d123 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:24.240706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa4446-f0c9-4004-abf9-8ca0ff05d123 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:24.240706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa4446-f0c9-4004-abf9-8ca0ff05d123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:24.332999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3baa4446-f0c9-4004-abf9-8ca0ff05d123 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:24.334112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3baa4446-f0c9-4004-abf9-8ca0ff05d123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:24.456056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:24.462916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 694/1379] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:24.815890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee4bb1-201a-4e39-8b1b-fa0e7e88bec4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:24.817736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0bee4bb1-201a-4e39-8b1b-fa0e7e88bec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:25.002421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:25.019367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee4bb1-201a-4e39-8b1b-fa0e7e88bec4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:25.172650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d567f50-74d8-4853-9480-7ed332056325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:25.173168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d567f50-74d8-4853-9480-7ed332056325 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:25.173442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d567f50-74d8-4853-9480-7ed332056325 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:25.173708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d567f50-74d8-4853-9480-7ed332056325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:25.175313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2d567f50-74d8-4853-9480-7ed332056325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:25.290836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d567f50-74d8-4853-9480-7ed332056325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:25.293944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d567f50-74d8-4853-9480-7ed332056325 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:25.305480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:25.315672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 686/1380] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:27.273306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d90f1-2647-428d-97c8-e4d25f25a971 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:27.273882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d90f1-2647-428d-97c8-e4d25f25a971 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:27.273882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d90f1-2647-428d-97c8-e4d25f25a971 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:27.275384 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 695/1381] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:27.280999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b582f0b-9939-492d-8854-aa554973b22f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:27.281434 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b582f0b-9939-492d-8854-aa554973b22f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:27.281704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b582f0b-9939-492d-8854-aa554973b22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:27.362412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0b582f0b-9939-492d-8854-aa554973b22f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:27.364051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0b582f0b-9939-492d-8854-aa554973b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:27.480152 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 687/1382] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:27.765355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d90f1-2647-428d-97c8-e4d25f25a971 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:27.767363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a6d90f1-2647-428d-97c8-e4d25f25a971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:27.952239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d90f1-2647-428d-97c8-e4d25f25a971 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:28.023435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:28.093090 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add125aa-b11f-4ae6-b36c-b55a6f845071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:28.093860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add125aa-b11f-4ae6-b36c-b55a6f845071 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:28.094208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add125aa-b11f-4ae6-b36c-b55a6f845071 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:28.094552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add125aa-b11f-4ae6-b36c-b55a6f845071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:28.096703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-add125aa-b11f-4ae6-b36c-b55a6f845071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:28.193476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add125aa-b11f-4ae6-b36c-b55a6f845071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:28.195212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add125aa-b11f-4ae6-b36c-b55a6f845071 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:28.215621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 696/1383] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:30.149889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5949f-7c7a-4a5e-ab60-c76b47f2b9d8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:30.150555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5949f-7c7a-4a5e-ab60-c76b47f2b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:30.150555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5949f-7c7a-4a5e-ab60-c76b47f2b9d8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:30.151933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 688/1384] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:30.157473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c457be-100c-40e3-9a6d-af20fe04ed4b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:30.157955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c457be-100c-40e3-9a6d-af20fe04ed4b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:30.158121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c457be-100c-40e3-9a6d-af20fe04ed4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:30.237010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-72c457be-100c-40e3-9a6d-af20fe04ed4b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:30.238530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-72c457be-100c-40e3-9a6d-af20fe04ed4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:30.279321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:30.364166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 697/1385] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:30.665347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5949f-7c7a-4a5e-ab60-c76b47f2b9d8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:30.666902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d9a5949f-7c7a-4a5e-ab60-c76b47f2b9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:30.746548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:30.825648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5949f-7c7a-4a5e-ab60-c76b47f2b9d8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:30.941867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274de11-d6ae-4afa-bc86-6d10fcf03e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:30.942395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274de11-d6ae-4afa-bc86-6d10fcf03e09 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:30.942674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274de11-d6ae-4afa-bc86-6d10fcf03e09 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:30.942968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274de11-d6ae-4afa-bc86-6d10fcf03e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:30.944591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3274de11-d6ae-4afa-bc86-6d10fcf03e09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:30.983453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:31.036501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274de11-d6ae-4afa-bc86-6d10fcf03e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:31.038099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274de11-d6ae-4afa-bc86-6d10fcf03e09 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:31.056996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 689/1386] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:33.045177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821377-0493-46de-9a6f-4e31aa8bfed3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:33.045788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821377-0493-46de-9a6f-4e31aa8bfed3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:33.045788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821377-0493-46de-9a6f-4e31aa8bfed3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:33.047099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 698/1387] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:33.052383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558fa64-0783-4d3d-a211-9ce580a948c0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:33.052838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558fa64-0783-4d3d-a211-9ce580a948c0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:33.052939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558fa64-0783-4d3d-a211-9ce580a948c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:33.122651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8558fa64-0783-4d3d-a211-9ce580a948c0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:33.123990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8558fa64-0783-4d3d-a211-9ce580a948c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:33.227432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 690/1388] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:33.520561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e821377-0493-46de-9a6f-4e31aa8bfed3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:33.522102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7e821377-0493-46de-9a6f-4e31aa8bfed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:33.640451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7817fe-61e8-416d-84da-943fd3c3381d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:33.640669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7817fe-61e8-416d-84da-943fd3c3381d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:33.640973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7817fe-61e8-416d-84da-943fd3c3381d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:33.642344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 691/1389] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:27:33.647432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468597d0-76c1-4d08-8288-808a93312196 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:33.647799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468597d0-76c1-4d08-8288-808a93312196 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:33.648141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468597d0-76c1-4d08-8288-808a93312196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:33.664186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:33.676874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e821377-0493-46de-9a6f-4e31aa8bfed3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:33.694493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:33.719543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-468597d0-76c1-4d08-8288-808a93312196 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:33.720771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-468597d0-76c1-4d08-8288-808a93312196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:33.796922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec47042-f603-45ec-9ccc-da1b3ad8b007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:33.797533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47042-f603-45ec-9ccc-da1b3ad8b007 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:33.797813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47042-f603-45ec-9ccc-da1b3ad8b007 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:33.798085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47042-f603-45ec-9ccc-da1b3ad8b007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:33.799758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ec47042-f603-45ec-9ccc-da1b3ad8b007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:33.821090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 692/1390] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:27:33.889464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec47042-f603-45ec-9ccc-da1b3ad8b007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:33.891195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec47042-f603-45ec-9ccc-da1b3ad8b007 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:33.909614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 699/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:34.138392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611460b-40e2-4a84-9265-374813d0e697 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:34.138906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611460b-40e2-4a84-9265-374813d0e697 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:34.139016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611460b-40e2-4a84-9265-374813d0e697 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:34.140302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 693/1392] 10.222.0.64 () {54 vars in 967 bytes} [Wed Aug 31 11:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:34.145452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed704a8-3757-4665-81ef-a909d6cf8b5d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:34.145872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed704a8-3757-4665-81ef-a909d6cf8b5d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:34.145972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed704a8-3757-4665-81ef-a909d6cf8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:34.172002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:34.223297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3ed704a8-3757-4665-81ef-a909d6cf8b5d None None] MFA Rules not processed for user `bb50ee2f9ccd4a258f3396074db66e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:34.224487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ed704a8-3757-4665-81ef-a909d6cf8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:34.300737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 700/1393] 10.222.0.64 () {58 vars in 1064 bytes} [Wed Aug 31 11:27:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:34.308799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611460b-40e2-4a84-9265-374813d0e697 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:34.310390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a611460b-40e2-4a84-9265-374813d0e697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:34.409701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:34.417418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611460b-40e2-4a84-9265-374813d0e697 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:34.491816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99147b-1931-41e3-aacf-4b3ee0c22626 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb50ee2f9ccd4a258f3396074db66e74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:34.492416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99147b-1931-41e3-aacf-4b3ee0c22626 service glance] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:34.492688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99147b-1931-41e3-aacf-4b3ee0c22626 service glance] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:34.492954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99147b-1931-41e3-aacf-4b3ee0c22626 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:34.494519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9c99147b-1931-41e3-aacf-4b3ee0c22626 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:34.602182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99147b-1931-41e3-aacf-4b3ee0c22626 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:34.603645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99147b-1931-41e3-aacf-4b3ee0c22626 service glance] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:34.622570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 694/1394] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:27:35.360005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baa940-985c-453a-b367-ebc4b199a76f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:35.360482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baa940-985c-453a-b367-ebc4b199a76f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:35.360604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baa940-985c-453a-b367-ebc4b199a76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:35.427182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-81baa940-985c-453a-b367-ebc4b199a76f None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:35.428369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-81baa940-985c-453a-b367-ebc4b199a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:35.488085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:35.516741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 701/1395] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:27:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:35.559466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cb5f3-23a2-4726-80f3-baa682d9521b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:35.559940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cb5f3-23a2-4726-80f3-baa682d9521b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:35.560069 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cb5f3-23a2-4726-80f3-baa682d9521b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:35.561389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 695/1396] 10.222.0.64 () {54 vars in 943 bytes} [Wed Aug 31 11:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:35.567553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a12485-13f9-4205-86be-1616d25338e5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:35.567864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a12485-13f9-4205-86be-1616d25338e5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:35.568137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a12485-13f9-4205-86be-1616d25338e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:35.647278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-59a12485-13f9-4205-86be-1616d25338e5 None None] MFA Rules not processed for user `a1966d24e4cf4a46b71dc2ec302a8d27`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:35.648490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-59a12485-13f9-4205-86be-1616d25338e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:35.760688 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 702/1397] 10.222.0.64 () {58 vars in 1040 bytes} [Wed Aug 31 11:27:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:35.770757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cb5f3-23a2-4726-80f3-baa682d9521b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:35.772273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-db1cb5f3-23a2-4726-80f3-baa682d9521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:35.796069 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:35.862358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22fb08-dc75-4b56-beb9-4da18caf4db4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:35.862658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22fb08-dc75-4b56-beb9-4da18caf4db4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:35.862983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22fb08-dc75-4b56-beb9-4da18caf4db4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:35.864367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 703/1398] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:35.869530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bd86a-8ff2-437c-9707-a90d46517b9f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:35.869674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bd86a-8ff2-437c-9707-a90d46517b9f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:35.869858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bd86a-8ff2-437c-9707-a90d46517b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:35.911590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cb5f3-23a2-4726-80f3-baa682d9521b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:35.915552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:35.938531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3d9bd86a-8ff2-437c-9707-a90d46517b9f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:35.939765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3d9bd86a-8ff2-437c-9707-a90d46517b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:36.017543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066f1e6-c781-4bd7-b8b2-8d957c74128a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:36.018150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066f1e6-c781-4bd7-b8b2-8d957c74128a service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:36.018426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066f1e6-c781-4bd7-b8b2-8d957c74128a service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:36.018711 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066f1e6-c781-4bd7-b8b2-8d957c74128a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:36.020327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a066f1e6-c781-4bd7-b8b2-8d957c74128a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:36.027924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:36.042548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 704/1399] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:27:36.110234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066f1e6-c781-4bd7-b8b2-8d957c74128a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:36.111785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066f1e6-c781-4bd7-b8b2-8d957c74128a service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:36.119843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 696/1400] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:27:36.337247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bd86a-8ff2-437c-9707-a90d46517b9f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:36.338457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3d9bd86a-8ff2-437c-9707-a90d46517b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:36.478913 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bd86a-8ff2-437c-9707-a90d46517b9f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:36.483248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:36.606701 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf351d6d-60c9-48c2-890b-f790b17fa11b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:36.607339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351d6d-60c9-48c2-890b-f790b17fa11b service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:36.607615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351d6d-60c9-48c2-890b-f790b17fa11b service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:36.607883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351d6d-60c9-48c2-890b-f790b17fa11b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:36.609515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cf351d6d-60c9-48c2-890b-f790b17fa11b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:36.712874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf351d6d-60c9-48c2-890b-f790b17fa11b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:36.715194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf351d6d-60c9-48c2-890b-f790b17fa11b service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:36.736946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 705/1401] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:38.682286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b80a3-b0ca-4067-9292-0c09c4e2e0c4 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:38.682905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b80a3-b0ca-4067-9292-0c09c4e2e0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:38.682905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b80a3-b0ca-4067-9292-0c09c4e2e0c4 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:38.687007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 697/1402] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:38.689749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e21945-401d-4327-9890-e1be0e382548 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:38.690233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e21945-401d-4327-9890-e1be0e382548 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:38.690325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e21945-401d-4327-9890-e1be0e382548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:38.704766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:38.776136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-60e21945-401d-4327-9890-e1be0e382548 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:38.778024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-60e21945-401d-4327-9890-e1be0e382548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:38.887170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 706/1403] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:39.189209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b80a3-b0ca-4067-9292-0c09c4e2e0c4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:39.190766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5f3b80a3-b0ca-4067-9292-0c09c4e2e0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:39.361470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b80a3-b0ca-4067-9292-0c09c4e2e0c4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:39.364454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:39.487230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75912b0-8758-4ed0-b477-e79625efdd87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:39.488035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75912b0-8758-4ed0-b477-e79625efdd87 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:39.488414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75912b0-8758-4ed0-b477-e79625efdd87 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:39.488788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75912b0-8758-4ed0-b477-e79625efdd87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:39.490545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e75912b0-8758-4ed0-b477-e79625efdd87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:39.586707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75912b0-8758-4ed0-b477-e79625efdd87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:39.588492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75912b0-8758-4ed0-b477-e79625efdd87 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:39.608628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 698/1404] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:41.562193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730e927-1cf0-485c-b228-f67cb3969601 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:41.562807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730e927-1cf0-485c-b228-f67cb3969601 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:41.562807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730e927-1cf0-485c-b228-f67cb3969601 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:41.564283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 707/1405] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:41.569858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df0cb-1b03-44d8-bef1-84a675c86566 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:41.570272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df0cb-1b03-44d8-bef1-84a675c86566 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:41.570450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df0cb-1b03-44d8-bef1-84a675c86566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:41.580603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:41.640638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-957df0cb-1b03-44d8-bef1-84a675c86566 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:41.641756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-957df0cb-1b03-44d8-bef1-84a675c86566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:41.762250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 699/1406] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:42.052347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730e927-1cf0-485c-b228-f67cb3969601 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:42.054000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f730e927-1cf0-485c-b228-f67cb3969601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:42.151119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:42.221388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730e927-1cf0-485c-b228-f67cb3969601 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:42.349090 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b427-f9a7-410b-a1ec-1f733272e210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:42.349612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b427-f9a7-410b-a1ec-1f733272e210 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:42.349893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b427-f9a7-410b-a1ec-1f733272e210 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:42.350168 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b427-f9a7-410b-a1ec-1f733272e210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:42.351844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2462b427-f9a7-410b-a1ec-1f733272e210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:42.410258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:42.458211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462b427-f9a7-410b-a1ec-1f733272e210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:42.460150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462b427-f9a7-410b-a1ec-1f733272e210 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:42.479521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 708/1407] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:51.759607 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=62 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:52.477032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=23 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:58.205779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc85bf9-493a-469c-ae72-983d3d2edd9b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:58.206333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc85bf9-493a-469c-ae72-983d3d2edd9b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:58.206333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc85bf9-493a-469c-ae72-983d3d2edd9b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:58.207682 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 700/1408] 10.222.0.64 () {54 vars in 918 bytes} [Wed Aug 31 11:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:58.212656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b78e8-a835-40f5-ad8a-695a3c5471c4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:58.213759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b78e8-a835-40f5-ad8a-695a3c5471c4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:58.213944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b78e8-a835-40f5-ad8a-695a3c5471c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:58.288351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-841b78e8-a835-40f5-ad8a-695a3c5471c4 None None] MFA Rules not processed for user `cc99489aa0e14928871b6f7b2c955068`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:58.289528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-841b78e8-a835-40f5-ad8a-695a3c5471c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:58.395991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 709/1409] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 31 11:27:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:58.410786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99010831-61d5-46d1-aeb6-c6db68cb6762 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:58.411073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99010831-61d5-46d1-aeb6-c6db68cb6762 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:58.411375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99010831-61d5-46d1-aeb6-c6db68cb6762 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:58.412677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 701/1410] 10.222.0.64 () {54 vars in 918 bytes} [Wed Aug 31 11:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:27:58.418127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d51e2-fc1d-412d-9369-3be4ca0d385e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:58.418407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d51e2-fc1d-412d-9369-3be4ca0d385e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:58.418676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d51e2-fc1d-412d-9369-3be4ca0d385e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:58.494129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:58.497321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c41d51e2-fc1d-412d-9369-3be4ca0d385e None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:27:58.499089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c41d51e2-fc1d-412d-9369-3be4ca0d385e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:58.615265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 710/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 31 11:27:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:28:01.009375 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38f263-e13c-450c-9408-d0ef618e7d28 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:01.011102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38f263-e13c-450c-9408-d0ef618e7d28 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:01.011102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38f263-e13c-450c-9408-d0ef618e7d28 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:01.012103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 702/1412] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:01.017269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cebac9-f21d-44a0-b30f-614cd4afee04 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:01.017714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cebac9-f21d-44a0-b30f-614cd4afee04 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:01.017820 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cebac9-f21d-44a0-b30f-614cd4afee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:01.086019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-43cebac9-f21d-44a0-b30f-614cd4afee04 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:01.087248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-43cebac9-f21d-44a0-b30f-614cd4afee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:01.143454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:01.186531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 711/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:28:01.477133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38f263-e13c-450c-9408-d0ef618e7d28 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:01.478740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cc38f263-e13c-450c-9408-d0ef618e7d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:01.623845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38f263-e13c-450c-9408-d0ef618e7d28 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:01.695682 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:01.736864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753f114-00af-4022-a3dd-0539ef7e9f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:01.737463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753f114-00af-4022-a3dd-0539ef7e9f86 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:01.737736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753f114-00af-4022-a3dd-0539ef7e9f86 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:01.738002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753f114-00af-4022-a3dd-0539ef7e9f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:01.739607 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4753f114-00af-4022-a3dd-0539ef7e9f86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:01.827276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753f114-00af-4022-a3dd-0539ef7e9f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:01.828880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753f114-00af-4022-a3dd-0539ef7e9f86 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:01.846415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 703/1414] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:02.736714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d1e10-77be-44db-ae49-49b1e1bbe05c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:02.737265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d1e10-77be-44db-ae49-49b1e1bbe05c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:02.737265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d1e10-77be-44db-ae49-49b1e1bbe05c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:02.738642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 712/1415] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:02.743639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85519fc-e4d6-408f-85ba-2b9d32d879de None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:02.744816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85519fc-e4d6-408f-85ba-2b9d32d879de None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:02.744816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85519fc-e4d6-408f-85ba-2b9d32d879de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:02.819604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b85519fc-e4d6-408f-85ba-2b9d32d879de None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:02.820831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b85519fc-e4d6-408f-85ba-2b9d32d879de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:02.847250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:02.917951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 704/1416] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:03.068972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d1e10-77be-44db-ae49-49b1e1bbe05c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:03.070485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-653d1e10-77be-44db-ae49-49b1e1bbe05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:03.216767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d1e10-77be-44db-ae49-49b1e1bbe05c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:03.255955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:03.327628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931466a-ba8c-4df3-bbb8-023711d56360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:03.328228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931466a-ba8c-4df3-bbb8-023711d56360 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:03.328505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931466a-ba8c-4df3-bbb8-023711d56360 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:03.328771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931466a-ba8c-4df3-bbb8-023711d56360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:03.330342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5931466a-ba8c-4df3-bbb8-023711d56360 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:03.419488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931466a-ba8c-4df3-bbb8-023711d56360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:03.421087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931466a-ba8c-4df3-bbb8-023711d56360 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:03.438588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 713/1417] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:04.316834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadd2f4-9831-4f4e-9887-4112f3631ad7 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:04.317380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadd2f4-9831-4f4e-9887-4112f3631ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:04.317380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadd2f4-9831-4f4e-9887-4112f3631ad7 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:04.318762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 705/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:04.324460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1fec7-8fca-47b0-a9a3-f74ea154aa3a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:04.324907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1fec7-8fca-47b0-a9a3-f74ea154aa3a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:04.325014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1fec7-8fca-47b0-a9a3-f74ea154aa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:04.378895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:04.402100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3fe1fec7-8fca-47b0-a9a3-f74ea154aa3a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:04.403344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3fe1fec7-8fca-47b0-a9a3-f74ea154aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:04.503401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 714/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:04.656205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadd2f4-9831-4f4e-9887-4112f3631ad7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:04.657635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7eadd2f4-9831-4f4e-9887-4112f3631ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:04.804807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadd2f4-9831-4f4e-9887-4112f3631ad7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:04.817508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:04.918070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeb668-2282-4aba-982d-15c802a6f3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:04.918586 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeb668-2282-4aba-982d-15c802a6f3e9 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:04.918892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeb668-2282-4aba-982d-15c802a6f3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:04.919162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeb668-2282-4aba-982d-15c802a6f3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:04.920748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-89eeb668-2282-4aba-982d-15c802a6f3e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:05.010361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeb668-2282-4aba-982d-15c802a6f3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:05.012011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeb668-2282-4aba-982d-15c802a6f3e9 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:05.029853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 706/1420] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:05.892706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c03387-d759-4531-87fe-4377369b790f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:05.893272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c03387-d759-4531-87fe-4377369b790f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:05.893272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c03387-d759-4531-87fe-4377369b790f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:05.894608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 715/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:05.899612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201df8-5c3f-4a01-a06d-2e22cfdbd3c3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:05.900677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201df8-5c3f-4a01-a06d-2e22cfdbd3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:05.900854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201df8-5c3f-4a01-a06d-2e22cfdbd3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:05.920141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:05.976016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1f201df8-5c3f-4a01-a06d-2e22cfdbd3c3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:05.977132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1f201df8-5c3f-4a01-a06d-2e22cfdbd3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:06.070934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 707/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:28:06.221379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c03387-d759-4531-87fe-4377369b790f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:06.222954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a7c03387-d759-4531-87fe-4377369b790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:06.332717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:06.369156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c03387-d759-4531-87fe-4377369b790f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:06.481122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bff1d-0a57-4321-90dd-3e7147ec7a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:06.481722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bff1d-0a57-4321-90dd-3e7147ec7a0f service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:06.482000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bff1d-0a57-4321-90dd-3e7147ec7a0f service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:06.482271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bff1d-0a57-4321-90dd-3e7147ec7a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:06.483892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1b7bff1d-0a57-4321-90dd-3e7147ec7a0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:06.559915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:06.574432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bff1d-0a57-4321-90dd-3e7147ec7a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:06.576089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bff1d-0a57-4321-90dd-3e7147ec7a0f service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:06.594848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 716/1423] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:07.447960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7fe9-7ae7-4124-8bfe-e43f37a0c27a None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:07.448475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7fe9-7ae7-4124-8bfe-e43f37a0c27a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:07.448475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7fe9-7ae7-4124-8bfe-e43f37a0c27a None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:07.449824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 708/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:07.454767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5011b-6c4e-4521-9a72-fd035733e4ff None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:07.455219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5011b-6c4e-4521-9a72-fd035733e4ff None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:07.455355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5011b-6c4e-4521-9a72-fd035733e4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:07.531336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e5a5011b-6c4e-4521-9a72-fd035733e4ff None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:07.532542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e5a5011b-6c4e-4521-9a72-fd035733e4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:07.627588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 717/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:07.779021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7fe9-7ae7-4124-8bfe-e43f37a0c27a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:07.780595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-22ed7fe9-7ae7-4124-8bfe-e43f37a0c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:07.864606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:07.926339 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7fe9-7ae7-4124-8bfe-e43f37a0c27a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:08.038314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b55787-a62f-4f29-9e22-8225cfe0d40b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:08.038947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55787-a62f-4f29-9e22-8225cfe0d40b service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:08.039223 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55787-a62f-4f29-9e22-8225cfe0d40b service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:08.039520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55787-a62f-4f29-9e22-8225cfe0d40b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:08.041177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e3b55787-a62f-4f29-9e22-8225cfe0d40b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:08.089115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:08.129566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b55787-a62f-4f29-9e22-8225cfe0d40b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:08.131199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b55787-a62f-4f29-9e22-8225cfe0d40b service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:08.149177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 709/1426] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:08.952972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ebd6a-c918-4960-9d19-171f834bd10d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:08.953516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ebd6a-c918-4960-9d19-171f834bd10d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:08.953516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ebd6a-c918-4960-9d19-171f834bd10d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:08.954831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 718/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:08.959822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c16bd7-088b-43c6-ae1e-41be34a5eb53 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:08.960275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c16bd7-088b-43c6-ae1e-41be34a5eb53 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:08.960387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c16bd7-088b-43c6-ae1e-41be34a5eb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:09.036475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-71c16bd7-088b-43c6-ae1e-41be34a5eb53 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:09.037686 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-71c16bd7-088b-43c6-ae1e-41be34a5eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:09.133378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 710/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:09.284673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ebd6a-c918-4960-9d19-171f834bd10d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:09.286191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b47ebd6a-c918-4960-9d19-171f834bd10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:09.336481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:09.436044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ebd6a-c918-4960-9d19-171f834bd10d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:09.548726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10b0d8-cd68-4ba2-b9f6-1fc371a27bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:09.549247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10b0d8-cd68-4ba2-b9f6-1fc371a27bf9 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:09.549523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10b0d8-cd68-4ba2-b9f6-1fc371a27bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:09.549794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10b0d8-cd68-4ba2-b9f6-1fc371a27bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:09.551396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3e10b0d8-cd68-4ba2-b9f6-1fc371a27bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:09.558653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:09.644300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10b0d8-cd68-4ba2-b9f6-1fc371a27bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:09.645892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10b0d8-cd68-4ba2-b9f6-1fc371a27bf9 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:09.664135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 719/1429] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:10.472429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e91f-ab46-4760-bc04-3a751431f23c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:10.473051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e91f-ab46-4760-bc04-3a751431f23c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:10.473051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e91f-ab46-4760-bc04-3a751431f23c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:10.474307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 711/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:10.479562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60544bfe-c6c1-4a72-ac81-cabe8569e8b7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:10.479983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60544bfe-c6c1-4a72-ac81-cabe8569e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:10.480094 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60544bfe-c6c1-4a72-ac81-cabe8569e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:10.556245 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-60544bfe-c6c1-4a72-ac81-cabe8569e8b7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:10.558150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-60544bfe-c6c1-4a72-ac81-cabe8569e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:10.624887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:10.653971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 720/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:10.804516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e91f-ab46-4760-bc04-3a751431f23c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:10.807111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cde4e91f-ab46-4760-bc04-3a751431f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:10.825456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:10.952882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e91f-ab46-4760-bc04-3a751431f23c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:11.038224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:11.064887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4c566-a0e3-4bf9-9f4d-dad91063ebbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:11.065419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c566-a0e3-4bf9-9f4d-dad91063ebbb service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:11.065695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c566-a0e3-4bf9-9f4d-dad91063ebbb service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:11.065963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c566-a0e3-4bf9-9f4d-dad91063ebbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:11.067574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-12c4c566-a0e3-4bf9-9f4d-dad91063ebbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:11.155304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4c566-a0e3-4bf9-9f4d-dad91063ebbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:11.156913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4c566-a0e3-4bf9-9f4d-dad91063ebbb service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:11.174281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 712/1432] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:11.975785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8d473-6e0b-45ea-8b3f-480528332b90 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:11.976329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8d473-6e0b-45ea-8b3f-480528332b90 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:11.976329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8d473-6e0b-45ea-8b3f-480528332b90 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:11.977620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 721/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:11.983602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723b3c9-dd96-454b-88dd-1817a44edef4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:11.984047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723b3c9-dd96-454b-88dd-1817a44edef4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:11.984218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723b3c9-dd96-454b-88dd-1817a44edef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:12.062049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1723b3c9-dd96-454b-88dd-1817a44edef4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:12.063329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1723b3c9-dd96-454b-88dd-1817a44edef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:12.104180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:12.159800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 713/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:12.309444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8d473-6e0b-45ea-8b3f-480528332b90 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:12.310993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-53e8d473-6e0b-45ea-8b3f-480528332b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:12.454839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8d473-6e0b-45ea-8b3f-480528332b90 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:12.508781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:12.574774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b66390-2108-4e40-94ae-102ff9c4d670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:12.575361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b66390-2108-4e40-94ae-102ff9c4d670 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:12.575641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b66390-2108-4e40-94ae-102ff9c4d670 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:12.575912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b66390-2108-4e40-94ae-102ff9c4d670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:12.577540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-83b66390-2108-4e40-94ae-102ff9c4d670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:12.668906 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b66390-2108-4e40-94ae-102ff9c4d670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:12.670635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b66390-2108-4e40-94ae-102ff9c4d670 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:12.689840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 722/1435] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:13.491181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49059f3-b072-44f1-b4bf-6a5c1fbb5361 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:13.491750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49059f3-b072-44f1-b4bf-6a5c1fbb5361 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:13.491750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49059f3-b072-44f1-b4bf-6a5c1fbb5361 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:13.493073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 714/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:13.498822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522685d-c5bc-4f28-a8f1-e6112f8afe21 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:13.499241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522685d-c5bc-4f28-a8f1-e6112f8afe21 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:13.499361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522685d-c5bc-4f28-a8f1-e6112f8afe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:13.575172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8522685d-c5bc-4f28-a8f1-e6112f8afe21 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:13.576361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8522685d-c5bc-4f28-a8f1-e6112f8afe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:13.578365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:13.672989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 723/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:13.822789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49059f3-b072-44f1-b4bf-6a5c1fbb5361 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:13.824306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c49059f3-b072-44f1-b4bf-6a5c1fbb5361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:13.969495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49059f3-b072-44f1-b4bf-6a5c1fbb5361 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:13.995790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:14.089716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a61052-fc8c-4c48-806f-df5ec21e2f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:14.090338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a61052-fc8c-4c48-806f-df5ec21e2f14 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:14.090614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a61052-fc8c-4c48-806f-df5ec21e2f14 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:14.090912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a61052-fc8c-4c48-806f-df5ec21e2f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:14.092504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-10a61052-fc8c-4c48-806f-df5ec21e2f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:14.183168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a61052-fc8c-4c48-806f-df5ec21e2f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:14.184759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a61052-fc8c-4c48-806f-df5ec21e2f14 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:14.202485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 715/1438] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:16.012551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a3c2-3040-4ca1-a407-5f416af2ac33 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:16.013112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a3c2-3040-4ca1-a407-5f416af2ac33 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:16.013112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a3c2-3040-4ca1-a407-5f416af2ac33 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:16.014439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 724/1439] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:16.019661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3012e-a0aa-41e8-b280-098e04a8bb83 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:16.020072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3012e-a0aa-41e8-b280-098e04a8bb83 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:16.020207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3012e-a0aa-41e8-b280-098e04a8bb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:16.061425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:16.086072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4be3012e-a0aa-41e8-b280-098e04a8bb83 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:16.087802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4be3012e-a0aa-41e8-b280-098e04a8bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:16.183004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 716/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:16.485250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cdc70-432a-4175-96f7-6c044dbf291e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:16.485532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cdc70-432a-4175-96f7-6c044dbf291e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:16.485810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cdc70-432a-4175-96f7-6c044dbf291e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:16.487264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 725/1441] 10.222.0.64 () {54 vars in 965 bytes} [Wed Aug 31 11:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:16.493150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43acaa-e0bc-458f-9d9d-fcb0d1a1232a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:16.493432 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43acaa-e0bc-458f-9d9d-fcb0d1a1232a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:16.493766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43acaa-e0bc-458f-9d9d-fcb0d1a1232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:16.573464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8f43acaa-e0bc-458f-9d9d-fcb0d1a1232a None None] MFA Rules not processed for user `e0f654bfe8364490a322b88433dd8fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:16.574720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8f43acaa-e0bc-458f-9d9d-fcb0d1a1232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:16.625393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:16.649650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 717/1442] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Aug 31 11:28:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:16.659329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cdc70-432a-4175-96f7-6c044dbf291e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:16.660928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-295cdc70-432a-4175-96f7-6c044dbf291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:16.764096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cdc70-432a-4175-96f7-6c044dbf291e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:16.795666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:16.836804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3c24a-e1e0-40a8-b9da-176ba6dcf9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:16.837919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3c24a-e1e0-40a8-b9da-176ba6dcf9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:16.838204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3c24a-e1e0-40a8-b9da-176ba6dcf9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:16.838482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3c24a-e1e0-40a8-b9da-176ba6dcf9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:16.840128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dbb3c24a-e1e0-40a8-b9da-176ba6dcf9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:16.949358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3c24a-e1e0-40a8-b9da-176ba6dcf9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:16.950844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3c24a-e1e0-40a8-b9da-176ba6dcf9f8 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:16.969450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 726/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:19.477071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f3efe-80e6-4640-8efe-6d6e45b80532 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:19.477633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f3efe-80e6-4640-8efe-6d6e45b80532 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:19.477633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f3efe-80e6-4640-8efe-6d6e45b80532 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:19.479036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:19.484525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d6c9f-b9a3-41f9-b5b4-2dc7e1961cc7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:19.484954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d6c9f-b9a3-41f9-b5b4-2dc7e1961cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:19.485066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d6c9f-b9a3-41f9-b5b4-2dc7e1961cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:19.550395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1a7d6c9f-b9a3-41f9-b5b4-2dc7e1961cc7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:19.551599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1a7d6c9f-b9a3-41f9-b5b4-2dc7e1961cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:19.564452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:19.647880 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:19.931943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f3efe-80e6-4640-8efe-6d6e45b80532 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:19.933508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0c9f3efe-80e6-4640-8efe-6d6e45b80532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:20.038442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f3efe-80e6-4640-8efe-6d6e45b80532 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:20.113718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb995d-9ff3-4605-b164-f31b8a3a51fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:20.114407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb995d-9ff3-4605-b164-f31b8a3a51fa service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:20.114715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb995d-9ff3-4605-b164-f31b8a3a51fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:20.114979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb995d-9ff3-4605-b164-f31b8a3a51fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:20.116560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-65cb995d-9ff3-4605-b164-f31b8a3a51fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:20.147879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:20.225384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb995d-9ff3-4605-b164-f31b8a3a51fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:20.226788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb995d-9ff3-4605-b164-f31b8a3a51fa service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:20.245853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 719/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:22.542982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be95cd0-de1c-4117-b702-8e23abfd4d28 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:22.543572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be95cd0-de1c-4117-b702-8e23abfd4d28 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:22.543572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be95cd0-de1c-4117-b702-8e23abfd4d28 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:22.544955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:22.550212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09710c-6a75-4df3-96be-4f197a6b8c4c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:22.550674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09710c-6a75-4df3-96be-4f197a6b8c4c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:22.550816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09710c-6a75-4df3-96be-4f197a6b8c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:22.616548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8b09710c-6a75-4df3-96be-4f197a6b8c4c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:22.617750 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8b09710c-6a75-4df3-96be-4f197a6b8c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:22.695863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:22.716386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:23.000324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be95cd0-de1c-4117-b702-8e23abfd4d28 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:23.001862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4be95cd0-de1c-4117-b702-8e23abfd4d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:23.113838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be95cd0-de1c-4117-b702-8e23abfd4d28 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:23.154574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:23.188563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e582b-a4af-4261-856f-b8cb4d9005d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:23.189151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e582b-a4af-4261-856f-b8cb4d9005d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:23.189432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e582b-a4af-4261-856f-b8cb4d9005d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:23.189709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e582b-a4af-4261-856f-b8cb4d9005d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:23.191361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-405e582b-a4af-4261-856f-b8cb4d9005d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:23.299833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e582b-a4af-4261-856f-b8cb4d9005d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:23.301208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e582b-a4af-4261-856f-b8cb4d9005d1 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:23.319500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 729/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:25.336620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5257e-d9c8-4dbd-8c4c-24da3a6c3311 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:25.337488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5257e-d9c8-4dbd-8c4c-24da3a6c3311 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:25.337488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5257e-d9c8-4dbd-8c4c-24da3a6c3311 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:25.338633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:25.343785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa872c3a-760e-414b-9d7f-72ca7e275bab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:25.344250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa872c3a-760e-414b-9d7f-72ca7e275bab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:25.344356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa872c3a-760e-414b-9d7f-72ca7e275bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:25.411760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-aa872c3a-760e-414b-9d7f-72ca7e275bab None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:25.412964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aa872c3a-760e-414b-9d7f-72ca7e275bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:25.433563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:25.508650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:25.793911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5257e-d9c8-4dbd-8c4c-24da3a6c3311 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:25.795533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-87e5257e-d9c8-4dbd-8c4c-24da3a6c3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:25.898587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5257e-d9c8-4dbd-8c4c-24da3a6c3311 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:25.973924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ecaad-1f19-4411-a1cb-eb6ed5e28ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:25.974441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ecaad-1f19-4411-a1cb-eb6ed5e28ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:25.974734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ecaad-1f19-4411-a1cb-eb6ed5e28ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:25.975004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ecaad-1f19-4411-a1cb-eb6ed5e28ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:25.976594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1b4ecaad-1f19-4411-a1cb-eb6ed5e28ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:26.020362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:26.092015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ecaad-1f19-4411-a1cb-eb6ed5e28ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:26.093456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ecaad-1f19-4411-a1cb-eb6ed5e28ec0 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:26.111925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 722/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:28.219452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b9eca-f2a5-43e6-94b1-af3b5d5324d0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:28.220048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b9eca-f2a5-43e6-94b1-af3b5d5324d0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:28.220048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b9eca-f2a5-43e6-94b1-af3b5d5324d0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:28.221354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:28.226523 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a24610-26f9-4e44-8d17-dfc5cdf3c16d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:28.226957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a24610-26f9-4e44-8d17-dfc5cdf3c16d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:28.227110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a24610-26f9-4e44-8d17-dfc5cdf3c16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:28.293357 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-30a24610-26f9-4e44-8d17-dfc5cdf3c16d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:28.294571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-30a24610-26f9-4e44-8d17-dfc5cdf3c16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:28.385321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:28.391557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:28.674662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b9eca-f2a5-43e6-94b1-af3b5d5324d0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:28.676226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c49b9eca-f2a5-43e6-94b1-af3b5d5324d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:28.781983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b9eca-f2a5-43e6-94b1-af3b5d5324d0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:28.831724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:28.857160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec121a-0c96-4b2d-9ee0-fe2ba912a07f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:28.857756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec121a-0c96-4b2d-9ee0-fe2ba912a07f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:28.858032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec121a-0c96-4b2d-9ee0-fe2ba912a07f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:28.858304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec121a-0c96-4b2d-9ee0-fe2ba912a07f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:28.859919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cdec121a-0c96-4b2d-9ee0-fe2ba912a07f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:28.969436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec121a-0c96-4b2d-9ee0-fe2ba912a07f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:28.970847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec121a-0c96-4b2d-9ee0-fe2ba912a07f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:28.988752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 732/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:31.049683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e53e0-a55c-46c9-8a88-19ec69bc620a None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:31.050257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e53e0-a55c-46c9-8a88-19ec69bc620a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:31.050257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e53e0-a55c-46c9-8a88-19ec69bc620a None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:31.051591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:31.057435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a4a3-52d2-43ad-b250-911848142d87 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:31.057829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a4a3-52d2-43ad-b250-911848142d87 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:31.057983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a4a3-52d2-43ad-b250-911848142d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:31.126072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8926a4a3-52d2-43ad-b250-911848142d87 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:31.127289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8926a4a3-52d2-43ad-b250-911848142d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:31.158026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:31.226119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:31.517272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e53e0-a55c-46c9-8a88-19ec69bc620a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:31.518833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-235e53e0-a55c-46c9-8a88-19ec69bc620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:31.620909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e53e0-a55c-46c9-8a88-19ec69bc620a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:31.693242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2b279-e0e0-4b57-a0ab-f702831809b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:31.693869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2b279-e0e0-4b57-a0ab-f702831809b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:31.694143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2b279-e0e0-4b57-a0ab-f702831809b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:31.694410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2b279-e0e0-4b57-a0ab-f702831809b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:31.697074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f9f2b279-e0e0-4b57-a0ab-f702831809b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:31.745712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:31.806881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2b279-e0e0-4b57-a0ab-f702831809b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:31.808309 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2b279-e0e0-4b57-a0ab-f702831809b9 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:31.826577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 725/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:33.763751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3356ee-63ef-42fd-81ee-7d7f77eef65e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:33.764310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3356ee-63ef-42fd-81ee-7d7f77eef65e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:33.764310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3356ee-63ef-42fd-81ee-7d7f77eef65e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:33.765655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:33.770864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb1236-0999-4809-9d0b-5eddf63beb40 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:33.771319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb1236-0999-4809-9d0b-5eddf63beb40 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:33.771456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb1236-0999-4809-9d0b-5eddf63beb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:33.836956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-16bb1236-0999-4809-9d0b-5eddf63beb40 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:33.838216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-16bb1236-0999-4809-9d0b-5eddf63beb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:33.933424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:34.215402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3356ee-63ef-42fd-81ee-7d7f77eef65e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:34.216920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2c3356ee-63ef-42fd-81ee-7d7f77eef65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:34.320633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3356ee-63ef-42fd-81ee-7d7f77eef65e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:34.375810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:34.394084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ec7ce-8e12-4eff-a5d9-24700ce54141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:34.394700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ec7ce-8e12-4eff-a5d9-24700ce54141 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:34.394997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ec7ce-8e12-4eff-a5d9-24700ce54141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:34.395273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ec7ce-8e12-4eff-a5d9-24700ce54141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:34.396869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc5ec7ce-8e12-4eff-a5d9-24700ce54141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:34.505141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ec7ce-8e12-4eff-a5d9-24700ce54141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:34.506591 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ec7ce-8e12-4eff-a5d9-24700ce54141 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:34.525463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 735/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:36.507184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e32f-e2f5-4b8b-9780-d652541872b6 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:36.507760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e32f-e2f5-4b8b-9780-d652541872b6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:36.507760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e32f-e2f5-4b8b-9780-d652541872b6 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:36.509120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:36.514303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86098807-93a8-46eb-a6d6-51a85bf08d99 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:36.514780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86098807-93a8-46eb-a6d6-51a85bf08d99 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:36.514880 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86098807-93a8-46eb-a6d6-51a85bf08d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:36.579623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-86098807-93a8-46eb-a6d6-51a85bf08d99 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:36.580813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-86098807-93a8-46eb-a6d6-51a85bf08d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:36.619158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:36.682933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:36.967646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e32f-e2f5-4b8b-9780-d652541872b6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:36.969201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-61f9e32f-e2f5-4b8b-9780-d652541872b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:36.973025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:37.071701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e32f-e2f5-4b8b-9780-d652541872b6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:37.144810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295794-a2db-4424-b116-ee2ba187a689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:37.145420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295794-a2db-4424-b116-ee2ba187a689 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:37.145692 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295794-a2db-4424-b116-ee2ba187a689 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:37.145959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295794-a2db-4424-b116-ee2ba187a689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:37.147565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-30295794-a2db-4424-b116-ee2ba187a689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:37.205481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:37.255731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30295794-a2db-4424-b116-ee2ba187a689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:37.257159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30295794-a2db-4424-b116-ee2ba187a689 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:37.275259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 728/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:39.193597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdcf61-0e5f-4e64-8dd2-2c9bb3d3225d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.194111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdcf61-0e5f-4e64-8dd2-2c9bb3d3225d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.194238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdcf61-0e5f-4e64-8dd2-2c9bb3d3225d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.195569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:39.201159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a08c5-ab32-4e60-a7a0-21cbd9ca0c16 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.201551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a08c5-ab32-4e60-a7a0-21cbd9ca0c16 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.201701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a08c5-ab32-4e60-a7a0-21cbd9ca0c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.387512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f87a08c5-ab32-4e60-a7a0-21cbd9ca0c16 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:39.388932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f87a08c5-ab32-4e60-a7a0-21cbd9ca0c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:39.484201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:39.769524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdcf61-0e5f-4e64-8dd2-2c9bb3d3225d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:39.771131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47fdcf61-0e5f-4e64-8dd2-2c9bb3d3225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:39.995697 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdcf61-0e5f-4e64-8dd2-2c9bb3d3225d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:40.062179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:40.069255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8efc8a-b016-44f2-9def-a25665c1f08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:40.069853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8efc8a-b016-44f2-9def-a25665c1f08e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:40.070130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8efc8a-b016-44f2-9def-a25665c1f08e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:40.070397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8efc8a-b016-44f2-9def-a25665c1f08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:40.073112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1f8efc8a-b016-44f2-9def-a25665c1f08e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:40.181275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8efc8a-b016-44f2-9def-a25665c1f08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:40.182759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8efc8a-b016-44f2-9def-a25665c1f08e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:40.200812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 738/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:42.119367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312903-33b6-4d50-a165-a11db83952a3 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:42.119967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312903-33b6-4d50-a165-a11db83952a3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:42.119967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312903-33b6-4d50-a165-a11db83952a3 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:42.121253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:42.126456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8d190-3cda-448a-b55b-9979f4736153 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:42.126942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8d190-3cda-448a-b55b-9979f4736153 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:42.127055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8d190-3cda-448a-b55b-9979f4736153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:42.192011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a3c8d190-3cda-448a-b55b-9979f4736153 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:42.193211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a3c8d190-3cda-448a-b55b-9979f4736153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:42.239860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:42.287554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:42.576354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312903-33b6-4d50-a165-a11db83952a3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:42.577923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5e312903-33b6-4d50-a165-a11db83952a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:42.592313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:42.684836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312903-33b6-4d50-a165-a11db83952a3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:42.758982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bcf0a-da86-4943-aaac-020fc54c910d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:42.759582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bcf0a-da86-4943-aaac-020fc54c910d service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:42.759849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bcf0a-da86-4943-aaac-020fc54c910d service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:42.760107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bcf0a-da86-4943-aaac-020fc54c910d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:42.761676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c99bcf0a-da86-4943-aaac-020fc54c910d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:42.827141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:42.868497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bcf0a-da86-4943-aaac-020fc54c910d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:42.869899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bcf0a-da86-4943-aaac-020fc54c910d service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:42.887543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 731/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:28:52.285674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=22 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:52.885326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=25 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:02.454172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ef6d-0639-45a5-82c3-2ffed76f1de1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:02.454793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ef6d-0639-45a5-82c3-2ffed76f1de1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:02.454793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ef6d-0639-45a5-82c3-2ffed76f1de1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:02.456082 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 740/1471] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:29:02.461743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1b4ed-47ac-4418-930c-21657a46a3b9 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:02.462182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1b4ed-47ac-4418-930c-21657a46a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:02.462359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1b4ed-47ac-4418-930c-21657a46a3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:02.527887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-50a1b4ed-47ac-4418-930c-21657a46a3b9 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:29:02.529075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-50a1b4ed-47ac-4418-930c-21657a46a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:02.623494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 732/1472] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:29:02.920256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bd09c-bf61-4d49-9a8a-fca10130cd91 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:02.920536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bd09c-bf61-4d49-9a8a-fca10130cd91 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:02.920808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bd09c-bf61-4d49-9a8a-fca10130cd91 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:02.922129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 741/1473] 10.222.0.64 () {54 vars in 967 bytes} [Wed Aug 31 11:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:29:02.927060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02870c3-f9fb-4423-9f5b-6b9cdd411ec5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:02.927343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02870c3-f9fb-4423-9f5b-6b9cdd411ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:02.927612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02870c3-f9fb-4423-9f5b-6b9cdd411ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:03.001643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e02870c3-f9fb-4423-9f5b-6b9cdd411ec5 None None] MFA Rules not processed for user `bb50ee2f9ccd4a258f3396074db66e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:29:03.002864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e02870c3-f9fb-4423-9f5b-6b9cdd411ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:03.023886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:03.079065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 733/1474] 10.222.0.64 () {58 vars in 1064 bytes} [Wed Aug 31 11:29:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:29:03.087490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bd09c-bf61-4d49-9a8a-fca10130cd91 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:29:03.089025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-752bd09c-bf61-4d49-9a8a-fca10130cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:03.191274 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bd09c-bf61-4d49-9a8a-fca10130cd91 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:29:03.265196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bac2a3-5943-4116-9b24-066d93782970 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb50ee2f9ccd4a258f3396074db66e74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:29:03.265792 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bac2a3-5943-4116-9b24-066d93782970 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:03.266071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bac2a3-5943-4116-9b24-066d93782970 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:03.266343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bac2a3-5943-4116-9b24-066d93782970 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:03.267957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-88bac2a3-5943-4116-9b24-066d93782970 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:03.321477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:03.376618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bac2a3-5943-4116-9b24-066d93782970 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:29:03.378066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bac2a3-5943-4116-9b24-066d93782970 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:29:03.396649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 742/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:29:05.414370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea38136-536a-40be-ad61-d228302779d8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:05.414873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea38136-536a-40be-ad61-d228302779d8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:05.414977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea38136-536a-40be-ad61-d228302779d8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:05.416319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 734/1476] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:29:05.421523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bfe16-57d6-42fe-8ebe-187384fed584 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:05.421925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bfe16-57d6-42fe-8ebe-187384fed584 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:05.422071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bfe16-57d6-42fe-8ebe-187384fed584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:05.488131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-508bfe16-57d6-42fe-8ebe-187384fed584 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:29:05.489320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-508bfe16-57d6-42fe-8ebe-187384fed584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:05.583883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 743/1477] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:29:05.858708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea38136-536a-40be-ad61-d228302779d8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:29:05.860305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dea38136-536a-40be-ad61-d228302779d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:05.983762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea38136-536a-40be-ad61-d228302779d8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:29:06.032430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:06.078422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f73fe3-677f-479f-8677-ecbd75281518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:29:06.079042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73fe3-677f-479f-8677-ecbd75281518 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:06.079316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73fe3-677f-479f-8677-ecbd75281518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:06.079576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73fe3-677f-479f-8677-ecbd75281518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:06.080202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f73fe3-677f-479f-8677-ecbd75281518 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:29:06.081894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-98f73fe3-677f-479f-8677-ecbd75281518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:29:06.081894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: warnings.warn(msg) Aug 31 11:29:06.081894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: Aug 31 11:29:06.083051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f73fe3-677f-479f-8677-ecbd75281518 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:29:06.102019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 735/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 31 11:29:05 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:29:08.034655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b196ce-5beb-48f7-ba81-5bcdf475d2c4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:08.035233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b196ce-5beb-48f7-ba81-5bcdf475d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:08.035233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b196ce-5beb-48f7-ba81-5bcdf475d2c4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:08.036562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 744/1479] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:29:08.041813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d422b4-a091-4146-b51b-2057a36f98fc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:08.042262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d422b4-a091-4146-b51b-2057a36f98fc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:08.042394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d422b4-a091-4146-b51b-2057a36f98fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:08.108019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d0d422b4-a091-4146-b51b-2057a36f98fc None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:29:08.109225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d0d422b4-a091-4146-b51b-2057a36f98fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:08.203666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 736/1480] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:29:08.493621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b196ce-5beb-48f7-ba81-5bcdf475d2c4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:29:08.495195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-63b196ce-5beb-48f7-ba81-5bcdf475d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:08.504889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:08.641061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b196ce-5beb-48f7-ba81-5bcdf475d2c4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:29:08.719291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:08.751845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35416e6e-260e-4303-9e11-0413f9fd4dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:29:08.752442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416e6e-260e-4303-9e11-0413f9fd4dab service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:08.752719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416e6e-260e-4303-9e11-0413f9fd4dab service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:08.752986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416e6e-260e-4303-9e11-0413f9fd4dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:08.754552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-35416e6e-260e-4303-9e11-0413f9fd4dab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:08.844081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35416e6e-260e-4303-9e11-0413f9fd4dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:29:08.845724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35416e6e-260e-4303-9e11-0413f9fd4dab service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:29:08.865291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 745/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:29:10.968189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a441c1-d871-48e2-a169-d471975395b5 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:10.968763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a441c1-d871-48e2-a169-d471975395b5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:10.968763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a441c1-d871-48e2-a169-d471975395b5 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:10.970020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 737/1482] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:29:10.975154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1973-7b4b-4b5f-856f-f8f96ff72666 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:10.975589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1973-7b4b-4b5f-856f-f8f96ff72666 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:10.975862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1973-7b4b-4b5f-856f-f8f96ff72666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:11.043273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-09bc1973-7b4b-4b5f-856f-f8f96ff72666 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:29:11.044486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-09bc1973-7b4b-4b5f-856f-f8f96ff72666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:11.091064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:11.141047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 746/1483] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:29:11.430897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a441c1-d871-48e2-a169-d471975395b5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:29:11.432430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e4a441c1-d871-48e2-a169-d471975395b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:11.455731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:11.535123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a441c1-d871-48e2-a169-d471975395b5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:29:11.606744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccb26a-3e5d-491e-bf27-4a1a8ce2c88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:29:11.607347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb26a-3e5d-491e-bf27-4a1a8ce2c88f service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:11.607626 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb26a-3e5d-491e-bf27-4a1a8ce2c88f service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:11.607895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb26a-3e5d-491e-bf27-4a1a8ce2c88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:11.609538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-43ccb26a-3e5d-491e-bf27-4a1a8ce2c88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:11.683445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:11.718539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccb26a-3e5d-491e-bf27-4a1a8ce2c88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:29:11.719996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccb26a-3e5d-491e-bf27-4a1a8ce2c88f service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:29:11.741492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 738/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:29:13.692838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963886c-839c-4713-a82b-5675ded77c34 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:13.693362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963886c-839c-4713-a82b-5675ded77c34 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:13.693362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963886c-839c-4713-a82b-5675ded77c34 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:13.694946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 747/1485] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:29:13.700147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb71af4-8ad6-4186-b9dc-c5e326807650 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:13.700596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb71af4-8ad6-4186-b9dc-c5e326807650 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:13.700728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb71af4-8ad6-4186-b9dc-c5e326807650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:13.766522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8bb71af4-8ad6-4186-b9dc-c5e326807650 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:29:13.767753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8bb71af4-8ad6-4186-b9dc-c5e326807650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:13.862255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 739/1486] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:29:14.150839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963886c-839c-4713-a82b-5675ded77c34 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:29:14.152376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9963886c-839c-4713-a82b-5675ded77c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:14.255204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963886c-839c-4713-a82b-5675ded77c34 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:29:14.326768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:14.328822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94b682-ecd6-4db2-a021-3b8184342296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:29:14.329444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94b682-ecd6-4db2-a021-3b8184342296 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:14.329930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94b682-ecd6-4db2-a021-3b8184342296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:14.330392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94b682-ecd6-4db2-a021-3b8184342296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:14.332205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5f94b682-ecd6-4db2-a021-3b8184342296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:14.440966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94b682-ecd6-4db2-a021-3b8184342296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:29:14.442400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94b682-ecd6-4db2-a021-3b8184342296 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:29:14.461101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 748/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:29:16.507044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbd881-e833-4a88-82d1-2816fb8ff07f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:16.507621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbd881-e833-4a88-82d1-2816fb8ff07f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:16.507621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbd881-e833-4a88-82d1-2816fb8ff07f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:16.508937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 740/1488] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:29:16.514027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8cbc7-b42e-4a7b-af17-c14b57f70b7d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:16.514435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8cbc7-b42e-4a7b-af17-c14b57f70b7d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:16.514564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8cbc7-b42e-4a7b-af17-c14b57f70b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:16.579072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c3b8cbc7-b42e-4a7b-af17-c14b57f70b7d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:29:16.580254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3b8cbc7-b42e-4a7b-af17-c14b57f70b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:16.632844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:16.676830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 749/1489] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:29:16.977128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbd881-e833-4a88-82d1-2816fb8ff07f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:29:16.978660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c5bbd881-e833-4a88-82d1-2816fb8ff07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:17.014137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:17.082515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbd881-e833-4a88-82d1-2816fb8ff07f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:29:17.155645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313725a-71ff-473e-ba87-69f71c7bccdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:29:17.156243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313725a-71ff-473e-ba87-69f71c7bccdb service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:17.156520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313725a-71ff-473e-ba87-69f71c7bccdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:17.156788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313725a-71ff-473e-ba87-69f71c7bccdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:17.158381 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e313725a-71ff-473e-ba87-69f71c7bccdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:17.237134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:17.266142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313725a-71ff-473e-ba87-69f71c7bccdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:29:17.267609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313725a-71ff-473e-ba87-69f71c7bccdb service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:29:17.285876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 741/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:29:19.418131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf076-dd47-4fad-8601-1e7aad9ab920 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:19.418619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf076-dd47-4fad-8601-1e7aad9ab920 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:19.418747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf076-dd47-4fad-8601-1e7aad9ab920 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:19.420080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 750/1491] 10.222.0.64 () {54 vars in 927 bytes} [Wed Aug 31 11:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:29:19.425498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69f0c-5b66-4ab8-82ed-08bb01365ea3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:19.425928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69f0c-5b66-4ab8-82ed-08bb01365ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:19.426034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69f0c-5b66-4ab8-82ed-08bb01365ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:19.494659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f1f69f0c-5b66-4ab8-82ed-08bb01365ea3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:29:19.495889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f1f69f0c-5b66-4ab8-82ed-08bb01365ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:19.589562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 742/1492] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Aug 31 11:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:29:19.879448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf076-dd47-4fad-8601-1e7aad9ab920 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:29:19.880998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-10eaf076-dd47-4fad-8601-1e7aad9ab920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:19.981779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf076-dd47-4fad-8601-1e7aad9ab920 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:29:20.054903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec4841-e175-4686-bbb5-7d3d1640916f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:29:20.055516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec4841-e175-4686-bbb5-7d3d1640916f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:20.055796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec4841-e175-4686-bbb5-7d3d1640916f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:20.056073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec4841-e175-4686-bbb5-7d3d1640916f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:20.058403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0eec4841-e175-4686-bbb5-7d3d1640916f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:20.067755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:20.169394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec4841-e175-4686-bbb5-7d3d1640916f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:29:20.170863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec4841-e175-4686-bbb5-7d3d1640916f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:29:20.188381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 751/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:29:29.587912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=82 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:30.186160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=50 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:41.541339 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bec960-7827-48ae-a6f8-b8d28a184d43 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:41.541898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bec960-7827-48ae-a6f8-b8d28a184d43 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:41.541898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bec960-7827-48ae-a6f8-b8d28a184d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:41.617576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-43bec960-7827-48ae-a6f8-b8d28a184d43 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:41.618802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-43bec960-7827-48ae-a6f8-b8d28a184d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:41.715856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 743/1494] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:30:41.724650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226ee0-6b30-48cf-91c7-84ae58d5fa2e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:41.725172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226ee0-6b30-48cf-91c7-84ae58d5fa2e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:41.725278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226ee0-6b30-48cf-91c7-84ae58d5fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:41.802056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9b226ee0-6b30-48cf-91c7-84ae58d5fa2e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:41.803287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9b226ee0-6b30-48cf-91c7-84ae58d5fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:41.899178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 752/1495] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:30:41.903796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bec960-7827-48ae-a6f8-b8d28a184d43 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:41.905015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-43bec960-7827-48ae-a6f8-b8d28a184d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:41.916927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bec960-7827-48ae-a6f8-b8d28a184d43 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:41.978641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:42.012482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:42.013086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:42.013360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:42.013628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:42.014272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:30:42.014569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:42.015609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:30:42.015609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: warnings.warn(msg) Aug 31 11:30:42.015609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: Aug 31 11:30:42.016496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:42.028054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 744/1496] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:30:42.036298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226ee0-6b30-48cf-91c7-84ae58d5fa2e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:42.045414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226ee0-6b30-48cf-91c7-84ae58d5fa2e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:42.108763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:42.142409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:42.143036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:42.143314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:42.143581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:42.145099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:42.146866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:30:42.146866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 31 11:30:42.146866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: Aug 31 11:30:42.148043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:42.205715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 753/1497] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:30:42 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:30:42.210878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:42.212445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:42.245384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e1f0-dd45-4e95-acbd-437c417589ea admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:42.339959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:42.340554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:42.340828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:42.341096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:42.341727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:42.342749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:30:42.342749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: warnings.warn(msg) Aug 31 11:30:42.342749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: Aug 31 11:30:42.343966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:42.387285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 745/1498] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:30:42 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:30:42.391514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:42.393084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:42.456466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00acead-0d40-4e4c-a7ae-d2f5fec9ba88 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:42.539534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:42.551266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105280be-542f-4746-990e-b44a6149486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:42.551894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105280be-542f-4746-990e-b44a6149486b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:42.552167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105280be-542f-4746-990e-b44a6149486b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:42.552431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105280be-542f-4746-990e-b44a6149486b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:42.553058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105280be-542f-4746-990e-b44a6149486b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:42.554060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-105280be-542f-4746-990e-b44a6149486b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:30:42.554060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 31 11:30:42.554060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: Aug 31 11:30:42.554964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105280be-542f-4746-990e-b44a6149486b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:42.567551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 754/1499] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:30:42.571806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:42.573303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:42.584751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708048-4a1c-417c-a883-27abb339fe29 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:42.610395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:42.680818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64482330-3e23-4393-953f-2dc9d77e40fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:42.681423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482330-3e23-4393-953f-2dc9d77e40fd admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:42.681696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482330-3e23-4393-953f-2dc9d77e40fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:42.681961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482330-3e23-4393-953f-2dc9d77e40fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:42.682593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64482330-3e23-4393-953f-2dc9d77e40fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:42.683628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-64482330-3e23-4393-953f-2dc9d77e40fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:30:42.683628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: warnings.warn(msg) Aug 31 11:30:42.683628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: Aug 31 11:30:42.684508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64482330-3e23-4393-953f-2dc9d77e40fd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:42.700775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 746/1500] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:30:42.702255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105280be-542f-4746-990e-b44a6149486b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:42.704176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-105280be-542f-4746-990e-b44a6149486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:42.741784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105280be-542f-4746-990e-b44a6149486b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:42.834385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3aad2-3e17-419b-a53c-886e72363fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:42.835002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3aad2-3e17-419b-a53c-886e72363fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:42.835282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3aad2-3e17-419b-a53c-886e72363fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:42.835570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3aad2-3e17-419b-a53c-886e72363fbe admin admin] PATH_INFO: `/v3/projects/0bc5536b6b8e4acd8f2e5328e0b288b6/users/89a89bfefa3c4da0a4942fa35fb49ebc/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:42.857828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3aad2-3e17-419b-a53c-886e72363fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc5536b6b8e4acd8f2e5328e0b288b6, user_id=89a89bfefa3c4da0a4942fa35fb49ebc, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:42.858940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-1be3aad2-3e17-419b-a53c-886e72363fbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:30:42.858940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 31 11:30:42.858940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: Aug 31 11:30:42.860911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3aad2-3e17-419b-a53c-886e72363fbe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:42.885774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 755/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:30:42 2022] PUT /identity/v3/projects/0bc5536b6b8e4acd8f2e5328e0b288b6/users/89a89bfefa3c4da0a4942fa35fb49ebc/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:30:42.898294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc567d-a011-4058-851a-1a37a25bd12e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:42.898589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc567d-a011-4058-851a-1a37a25bd12e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:42.898901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc567d-a011-4058-851a-1a37a25bd12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:42.956718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e3bc567d-a011-4058-851a-1a37a25bd12e None None] MFA Rules not processed for user `89a89bfefa3c4da0a4942fa35fb49ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:42.957957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e3bc567d-a011-4058-851a-1a37a25bd12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:43.033768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 747/1502] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:30:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:30:43.048056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec970f-8113-4ab7-b4db-a77237eb7a28 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:43.048346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec970f-8113-4ab7-b4db-a77237eb7a28 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:43.048623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec970f-8113-4ab7-b4db-a77237eb7a28 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:43.049956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 756/1503] 10.222.0.64 () {54 vars in 964 bytes} [Wed Aug 31 11:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:30:43.055904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa811-b71d-4301-befd-c88f4f82140f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:43.056189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa811-b71d-4301-befd-c88f4f82140f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:43.056459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa811-b71d-4301-befd-c88f4f82140f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:43.087523 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:43.132641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-959aa811-b71d-4301-befd-c88f4f82140f None None] MFA Rules not processed for user `0f4db8824b7e4ae6880840e3c8680610`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:43.133865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-959aa811-b71d-4301-befd-c88f4f82140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:43.208780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 748/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Wed Aug 31 11:30:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:30:43.216718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec970f-8113-4ab7-b4db-a77237eb7a28 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:43.218215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cfec970f-8113-4ab7-b4db-a77237eb7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:43.268147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:43.322109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec970f-8113-4ab7-b4db-a77237eb7a28 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:43.396813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:43.397333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:43.397613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:43.397886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:43.399514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:43.498537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:43.500018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:43.503945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:43.518512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 757/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:30:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:30:43.570598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cde3d0-8b7f-414b-b23b-e5b5b0dd6a40 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:43.570949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cde3d0-8b7f-414b-b23b-e5b5b0dd6a40 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:43.571221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cde3d0-8b7f-414b-b23b-e5b5b0dd6a40 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:43.572458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 749/1506] 10.222.0.64 () {52 vars in 830 bytes} [Wed Aug 31 11:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:30:43.576003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:43.577210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:43.678941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c206a35-bf92-40c6-97fd-f9904abfe0d2 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:43.773776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:43.774432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:43.774659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:43.774962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] PATH_INFO: `/v3/users/89a89bfefa3c4da0a4942fa35fb49ebc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:43.787288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a89bfefa3c4da0a4942fa35fb49ebc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:43.788318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:30:43.788318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 31 11:30:43.788318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: Aug 31 11:30:43.789520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:43.798928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:43.853230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a89bfefa3c4da0a4942fa35fb49ebc'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:43.876780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a89bfefa3c4da0a4942fa35fb49ebc'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:43.891314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a89bfefa3c4da0a4942fa35fb49ebc'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:43.900439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a89bfefa3c4da0a4942fa35fb49ebc'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:43.900900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a89bfefa3c4da0a4942fa35fb49ebc'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:43.906638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 758/1507] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:30:43 2022] DELETE /identity/v3/users/89a89bfefa3c4da0a4942fa35fb49ebc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:30:43.911179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c2192-9774-4420-a42c-24c7b4755aca None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:43.911464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c2192-9774-4420-a42c-24c7b4755aca None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:43.911737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c2192-9774-4420-a42c-24c7b4755aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:43.969518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f79c2192-9774-4420-a42c-24c7b4755aca None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:43.970639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f79c2192-9774-4420-a42c-24c7b4755aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:44.048127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:44.062211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 750/1508] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:30:44.073090 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:44.074326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:44.174118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf0f7-608a-442b-b6a0-0a9d869597be admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:44.231558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:44.252422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e5a55-b0eb-4a52-bf7e-39ba6ff95c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:44.253055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e5a55-b0eb-4a52-bf7e-39ba6ff95c00 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:44.253447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e5a55-b0eb-4a52-bf7e-39ba6ff95c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:44.254014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e5a55-b0eb-4a52-bf7e-39ba6ff95c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:44.255649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-974e5a55-b0eb-4a52-bf7e-39ba6ff95c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:44.365173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e5a55-b0eb-4a52-bf7e-39ba6ff95c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:44.366635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e5a55-b0eb-4a52-bf7e-39ba6ff95c00 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:44.385241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 759/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:30:44.831676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c2192-9774-4420-a42c-24c7b4755aca None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:44.833486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f79c2192-9774-4420-a42c-24c7b4755aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:44.844889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c2192-9774-4420-a42c-24c7b4755aca None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:44.943741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:44.944378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:44.944652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:44.944920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] PATH_INFO: `/v3/projects/0bc5536b6b8e4acd8f2e5328e0b288b6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:44.955234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc5536b6b8e4acd8f2e5328e0b288b6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:44.956319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:30:44.956319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: warnings.warn(msg) Aug 31 11:30:44.956319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: Aug 31 11:30:44.957584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:45.017285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc5536b6b8e4acd8f2e5328e0b288b6', 'request_id': 'req-c80406d3-43f4-45fb-ac52-f4873067d83e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:45.030298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc5536b6b8e4acd8f2e5328e0b288b6', 'request_id': 'req-c80406d3-43f4-45fb-ac52-f4873067d83e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:45.037029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc5536b6b8e4acd8f2e5328e0b288b6', 'request_id': 'req-c80406d3-43f4-45fb-ac52-f4873067d83e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:45.064497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] The token cache is being invalidate because project 0bc5536b6b8e4acd8f2e5328e0b288b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:30:45.064781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:45.065297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c80406d3-43f4-45fb-ac52-f4873067d83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:45.066662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 751/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:30:44 2022] DELETE /identity/v3/projects/0bc5536b6b8e4acd8f2e5328e0b288b6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:30:54.382997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=62 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:55.062513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:19.712311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f5f8-0880-4163-bf27-f92f587aa857 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:19.712925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f5f8-0880-4163-bf27-f92f587aa857 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:19.712925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f5f8-0880-4163-bf27-f92f587aa857 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:19.714230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:32:19.719141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989df2-092d-44c9-bbae-8fa59c1c3036 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:19.719601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989df2-092d-44c9-bbae-8fa59c1c3036 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:19.719708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989df2-092d-44c9-bbae-8fa59c1c3036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:19.801948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b4989df2-092d-44c9-bbae-8fa59c1c3036 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:19.803097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b4989df2-092d-44c9-bbae-8fa59c1c3036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:19.905223 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:32:20.060647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f5f8-0880-4163-bf27-f92f587aa857 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:20.062919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c1c4f5f8-0880-4163-bf27-f92f587aa857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:20.188976 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f5f8-0880-4163-bf27-f92f587aa857 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:20.195196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65291d43-f323-4389-9359-857829c707c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:20.195809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65291d43-f323-4389-9359-857829c707c6 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:20.196096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65291d43-f323-4389-9359-857829c707c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:20.196368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65291d43-f323-4389-9359-857829c707c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:20.204716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65291d43-f323-4389-9359-857829c707c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:20.207092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65291d43-f323-4389-9359-857829c707c6 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:20.217173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 761/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:21.047353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac92ce7-e1c5-410b-81db-b4d411daf24f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:21.047915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac92ce7-e1c5-410b-81db-b4d411daf24f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:21.047915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac92ce7-e1c5-410b-81db-b4d411daf24f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:21.049312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:32:21.054121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9af7f-a492-4a2d-bcc8-7c318016b81a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:21.054569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9af7f-a492-4a2d-bcc8-7c318016b81a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:21.054732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9af7f-a492-4a2d-bcc8-7c318016b81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:21.075501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-94f9af7f-a492-4a2d-bcc8-7c318016b81a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:21.076813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-94f9af7f-a492-4a2d-bcc8-7c318016b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:21.085639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:32:21.237857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac92ce7-e1c5-410b-81db-b4d411daf24f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:21.252059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac92ce7-e1c5-410b-81db-b4d411daf24f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:21.258125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e2a76-04fe-45d7-808d-702370defede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:21.258742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e2a76-04fe-45d7-808d-702370defede service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:21.259026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e2a76-04fe-45d7-808d-702370defede service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:21.259299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e2a76-04fe-45d7-808d-702370defede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:21.267261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e2a76-04fe-45d7-808d-702370defede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:21.269452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e2a76-04fe-45d7-808d-702370defede service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:21.278768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 754/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:22.061771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c315a2-68b4-45b1-945f-5c58f5351ffb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:22.062365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c315a2-68b4-45b1-945f-5c58f5351ffb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:22.062365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c315a2-68b4-45b1-945f-5c58f5351ffb None None] PATH_INFO: `/v3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:22.063660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 763/1517] 10.222.0.66 () {54 vars in 925 bytes} [Wed Aug 31 11:32:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:32:22.069857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0542188-9f7f-4924-93b0-da37fc56974c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:22.070319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0542188-9f7f-4924-93b0-da37fc56974c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:22.070427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0542188-9f7f-4924-93b0-da37fc56974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:22.129345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e0542188-9f7f-4924-93b0-da37fc56974c None None] MFA Rules not processed for user `cc99489aa0e14928871b6f7b2c955068`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:22.130528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e0542188-9f7f-4924-93b0-da37fc56974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:22.147133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:22.199701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 755/1518] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Aug 31 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:32:26.011791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64c82-501d-4509-a33d-fdcba2d42ee7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:26.012356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64c82-501d-4509-a33d-fdcba2d42ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:26.012356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64c82-501d-4509-a33d-fdcba2d42ee7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:26.013662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 764/1519] 10.222.0.64 () {54 vars in 961 bytes} [Wed Aug 31 11:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:32:26.018888 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd75e9-f60e-4244-9118-ff3b24d5da50 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:26.019350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd75e9-f60e-4244-9118-ff3b24d5da50 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:26.019447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd75e9-f60e-4244-9118-ff3b24d5da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:26.039098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3ccd75e9-f60e-4244-9118-ff3b24d5da50 None None] MFA Rules not processed for user `cc99489aa0e14928871b6f7b2c955068`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:26.040291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3ccd75e9-f60e-4244-9118-ff3b24d5da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:26.048784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 756/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Aug 31 11:32:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:32:26.056552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64c82-501d-4509-a33d-fdcba2d42ee7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:26.070565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64c82-501d-4509-a33d-fdcba2d42ee7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:26.076768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac2b6-f590-431b-b277-e1cf9d224810 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:26.077365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac2b6-f590-431b-b277-e1cf9d224810 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:26.077648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac2b6-f590-431b-b277-e1cf9d224810 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:26.077925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac2b6-f590-431b-b277-e1cf9d224810 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:26.088022 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ac2b6-f590-431b-b277-e1cf9d224810 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:26.089858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ac2b6-f590-431b-b277-e1cf9d224810 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:26.102102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 765/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:32.549622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661022-c00b-4d37-8bbf-39f31080df18 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:32.550168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661022-c00b-4d37-8bbf-39f31080df18 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:32.550285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661022-c00b-4d37-8bbf-39f31080df18 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:32.551634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:32:32.556271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03fd69-7800-4def-8b6f-4de7b487ed9b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:32.556683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03fd69-7800-4def-8b6f-4de7b487ed9b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:32.556793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03fd69-7800-4def-8b6f-4de7b487ed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:32.576164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eb03fd69-7800-4def-8b6f-4de7b487ed9b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:32.577350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb03fd69-7800-4def-8b6f-4de7b487ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:32.585884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:32:32.742456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3661022-c00b-4d37-8bbf-39f31080df18 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:32.757641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3661022-c00b-4d37-8bbf-39f31080df18 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:32.763165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4644ed-a4ab-41e6-9726-7cdaee1a3446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:32.763767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4644ed-a4ab-41e6-9726-7cdaee1a3446 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:32.764048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4644ed-a4ab-41e6-9726-7cdaee1a3446 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:32.764324 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4644ed-a4ab-41e6-9726-7cdaee1a3446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:32.773109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4644ed-a4ab-41e6-9726-7cdaee1a3446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:32.774704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4644ed-a4ab-41e6-9726-7cdaee1a3446 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:32.784976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 758/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:33.600926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e227e-f0b7-484a-b692-002e9a805ff4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:33.601436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e227e-f0b7-484a-b692-002e9a805ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:33.601563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e227e-f0b7-484a-b692-002e9a805ff4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:33.602830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:32:33.607761 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5ad41-462d-4ada-a22d-207237190d4a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:33.608146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5ad41-462d-4ada-a22d-207237190d4a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:33.608365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5ad41-462d-4ada-a22d-207237190d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:33.628802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-11a5ad41-462d-4ada-a22d-207237190d4a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:33.629987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-11a5ad41-462d-4ada-a22d-207237190d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:33.637852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:32:33.789270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e227e-f0b7-484a-b692-002e9a805ff4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:33.804522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e227e-f0b7-484a-b692-002e9a805ff4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:33.810081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba951b2-3ee2-4ab5-a21a-0c750b688f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:33.810677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba951b2-3ee2-4ab5-a21a-0c750b688f98 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:33.810980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba951b2-3ee2-4ab5-a21a-0c750b688f98 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:33.811247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba951b2-3ee2-4ab5-a21a-0c750b688f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:33.820056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba951b2-3ee2-4ab5-a21a-0c750b688f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:33.821633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba951b2-3ee2-4ab5-a21a-0c750b688f98 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:33.831210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 768/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:37.586671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdf2f-de19-4bf4-804a-ea26bb07ed8d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:37.587226 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdf2f-de19-4bf4-804a-ea26bb07ed8d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:37.587226 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdf2f-de19-4bf4-804a-ea26bb07ed8d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:37.588586 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:32:37.593747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79a23-c660-4fc3-bb2b-54cfbde2c628 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:37.594169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79a23-c660-4fc3-bb2b-54cfbde2c628 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:37.594296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79a23-c660-4fc3-bb2b-54cfbde2c628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:37.615069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0fc79a23-c660-4fc3-bb2b-54cfbde2c628 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:37.616248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0fc79a23-c660-4fc3-bb2b-54cfbde2c628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:37.623909 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:32:37.917603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bdf2f-de19-4bf4-804a-ea26bb07ed8d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:37.919340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e70bdf2f-de19-4bf4-804a-ea26bb07ed8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:37.997320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bdf2f-de19-4bf4-804a-ea26bb07ed8d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:38.000948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9311a-eb01-49f9-8e95-dc5914072f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:38.001544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9311a-eb01-49f9-8e95-dc5914072f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:38.001843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9311a-eb01-49f9-8e95-dc5914072f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:38.002169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9311a-eb01-49f9-8e95-dc5914072f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:38.010985 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9311a-eb01-49f9-8e95-dc5914072f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:38.012404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9311a-eb01-49f9-8e95-dc5914072f2d service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:38.022298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 761/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:39.920649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6915e08-ec22-425f-9330-96ebd8b9a85b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:39.921167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6915e08-ec22-425f-9330-96ebd8b9a85b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:39.921167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6915e08-ec22-425f-9330-96ebd8b9a85b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:39.922444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:32:39.928455 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0522036-5dc4-4d9d-b3ee-ef78fe441dde None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:39.928910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0522036-5dc4-4d9d-b3ee-ef78fe441dde None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:39.929045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0522036-5dc4-4d9d-b3ee-ef78fe441dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:39.948347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b0522036-5dc4-4d9d-b3ee-ef78fe441dde None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:39.949533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b0522036-5dc4-4d9d-b3ee-ef78fe441dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:39.957274 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:32:40.244798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6915e08-ec22-425f-9330-96ebd8b9a85b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:40.255723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6915e08-ec22-425f-9330-96ebd8b9a85b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:40.259430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069c91d-c907-46ad-a8e5-fd14e77b2764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:40.260034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069c91d-c907-46ad-a8e5-fd14e77b2764 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:40.260312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069c91d-c907-46ad-a8e5-fd14e77b2764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:40.260584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069c91d-c907-46ad-a8e5-fd14e77b2764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:40.270189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069c91d-c907-46ad-a8e5-fd14e77b2764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:40.271687 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069c91d-c907-46ad-a8e5-fd14e77b2764 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:40.281010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 771/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:43.825999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e362e-ea4c-4c86-8b55-f7cb4bc2205c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:43.826535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e362e-ea4c-4c86-8b55-f7cb4bc2205c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:43.826535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e362e-ea4c-4c86-8b55-f7cb4bc2205c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:43.827860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:32:43.833607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc853d6-120f-4b1f-96d1-51336366b897 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:43.834056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc853d6-120f-4b1f-96d1-51336366b897 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:43.834172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc853d6-120f-4b1f-96d1-51336366b897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:43.854554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7cc853d6-120f-4b1f-96d1-51336366b897 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:43.855788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7cc853d6-120f-4b1f-96d1-51336366b897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:43.864057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:32:44.421273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e362e-ea4c-4c86-8b55-f7cb4bc2205c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:44.422999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0e3e362e-ea4c-4c86-8b55-f7cb4bc2205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:44.487730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:44.500862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e362e-ea4c-4c86-8b55-f7cb4bc2205c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:44.504541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a3c06-7bf8-4181-b00c-b20efa6e58c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:44.505134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3c06-7bf8-4181-b00c-b20efa6e58c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:44.505411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3c06-7bf8-4181-b00c-b20efa6e58c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:44.505682 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3c06-7bf8-4181-b00c-b20efa6e58c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:44.514328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a3c06-7bf8-4181-b00c-b20efa6e58c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:44.515772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a3c06-7bf8-4181-b00c-b20efa6e58c0 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:44.524955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 764/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:46.474088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adceb66e-e49d-419d-ba7f-8c169fee40b6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:46.474798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adceb66e-e49d-419d-ba7f-8c169fee40b6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:46.474798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adceb66e-e49d-419d-ba7f-8c169fee40b6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:46.476026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:32:46.481386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd65f48-28a5-4bce-a46d-17760fb720f3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:46.481853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd65f48-28a5-4bce-a46d-17760fb720f3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:46.481958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd65f48-28a5-4bce-a46d-17760fb720f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:46.502010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8fd65f48-28a5-4bce-a46d-17760fb720f3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:32:46.503236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8fd65f48-28a5-4bce-a46d-17760fb720f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:46.511273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:32:47.061443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adceb66e-e49d-419d-ba7f-8c169fee40b6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:47.063495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-adceb66e-e49d-419d-ba7f-8c169fee40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:47.071113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:47.077538 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adceb66e-e49d-419d-ba7f-8c169fee40b6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:47.081918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54a3f8-417f-4688-81c9-2608c613fbe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:47.082509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a3f8-417f-4688-81c9-2608c613fbe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:47.082821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a3f8-417f-4688-81c9-2608c613fbe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:47.083096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a3f8-417f-4688-81c9-2608c613fbe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:47.091943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54a3f8-417f-4688-81c9-2608c613fbe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:47.093422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54a3f8-417f-4688-81c9-2608c613fbe1 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:47.103693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 774/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:56.497130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=11 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:57.099453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:13.617629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff2fd-def2-469a-9ec2-0a6c64daf15a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.619034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff2fd-def2-469a-9ec2-0a6c64daf15a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.619535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff2fd-def2-469a-9ec2-0a6c64daf15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.651570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-536ff2fd-def2-469a-9ec2-0a6c64daf15a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:13.652940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-536ff2fd-def2-469a-9ec2-0a6c64daf15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:13.663344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 766/1540] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:13.677083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69883137-4775-43f8-ab60-93ad2e5e405d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.678069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69883137-4775-43f8-ab60-93ad2e5e405d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.678570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69883137-4775-43f8-ab60-93ad2e5e405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.696609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf6275-7980-4dae-aefd-1747b59db09c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.696951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf6275-7980-4dae-aefd-1747b59db09c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.697210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf6275-7980-4dae-aefd-1747b59db09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.707340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-69883137-4775-43f8-ab60-93ad2e5e405d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:13.708865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-69883137-4775-43f8-ab60-93ad2e5e405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:13.718164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 775/1541] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:13.724366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69883137-4775-43f8-ab60-93ad2e5e405d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:13.725655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-38bf6275-7980-4dae-aefd-1747b59db09c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:13.726891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-38bf6275-7980-4dae-aefd-1747b59db09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:13.742892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69883137-4775-43f8-ab60-93ad2e5e405d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:13.745361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 767/1542] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:13.754998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:13.755853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.756136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.756410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.757070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:13.757374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:13.758400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:34:13.758400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 31 11:34:13.758400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: Aug 31 11:34:13.759329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:13.765848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbc43d-eb11-4618-8d17-08aac42bcae6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.766165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbc43d-eb11-4618-8d17-08aac42bcae6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.766403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbc43d-eb11-4618-8d17-08aac42bcae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.799748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9fdbc43d-eb11-4618-8d17-08aac42bcae6 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:13.802613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 776/1543] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:13.807940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9fdbc43d-eb11-4618-8d17-08aac42bcae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:13.811615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:13.834254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 768/1544] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:13.835011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab7fd2-d9d9-4faa-b68e-90ee0ddd00dc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:13.836309 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c9ac0-d115-4f16-9531-4da5d2fa477e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.836813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c9ac0-d115-4f16-9531-4da5d2fa477e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.837286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c9ac0-d115-4f16-9531-4da5d2fa477e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.874723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3468e-581d-431b-a071-d0f217411e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:13.874723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3468e-581d-431b-a071-d0f217411e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.874723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3468e-581d-431b-a071-d0f217411e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.874723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3468e-581d-431b-a071-d0f217411e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.875220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3468e-581d-431b-a071-d0f217411e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:13.875577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3468e-581d-431b-a071-d0f217411e9f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:13.876960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c73c9ac0-d115-4f16-9531-4da5d2fa477e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:13.879389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c73c9ac0-d115-4f16-9531-4da5d2fa477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:13.899411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 769/1545] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:13.900415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c9ac0-d115-4f16-9531-4da5d2fa477e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:13.914646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c9ac0-d115-4f16-9531-4da5d2fa477e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:13.928606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831c81e-fd49-4d7a-a96c-b746d64f13db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:13.929251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831c81e-fd49-4d7a-a96c-b746d64f13db admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.929529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831c81e-fd49-4d7a-a96c-b746d64f13db admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.929798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831c81e-fd49-4d7a-a96c-b746d64f13db admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.930482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831c81e-fd49-4d7a-a96c-b746d64f13db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:13.931024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831c81e-fd49-4d7a-a96c-b746d64f13db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:13.932733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831c81e-fd49-4d7a-a96c-b746d64f13db admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:13.956671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 770/1546] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:13.958145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742752-27ec-4309-90b8-99aca97e1315 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.958439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742752-27ec-4309-90b8-99aca97e1315 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.958723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742752-27ec-4309-90b8-99aca97e1315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.976109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 777/1547] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:13 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:34:13.977545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abb9fc-139e-4966-82ee-150d62df05b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:13.977833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abb9fc-139e-4966-82ee-150d62df05b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:13.978108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abb9fc-139e-4966-82ee-150d62df05b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:13.997067 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0d742752-27ec-4309-90b8-99aca97e1315 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:13.998272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0d742752-27ec-4309-90b8-99aca97e1315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.020109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-08abb9fc-139e-4966-82ee-150d62df05b2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.021801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-08abb9fc-139e-4966-82ee-150d62df05b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.081995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 771/1548] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.082979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d742752-27ec-4309-90b8-99aca97e1315 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.104443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d742752-27ec-4309-90b8-99aca97e1315 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.112208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc04ad8-e641-4adb-837f-f949471a62ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.113034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc04ad8-e641-4adb-837f-f949471a62ac admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.113386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc04ad8-e641-4adb-837f-f949471a62ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.113664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc04ad8-e641-4adb-837f-f949471a62ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.114308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc04ad8-e641-4adb-837f-f949471a62ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.115480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-dbc04ad8-e641-4adb-837f-f949471a62ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:34:14.115480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: warnings.warn(msg) Aug 31 11:34:14.115480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: Aug 31 11:34:14.116689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc04ad8-e641-4adb-837f-f949471a62ac admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.155270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 772/1549] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/projects => generated 391 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:14.156464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc04ad8-e641-4adb-837f-f949471a62ac admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.166598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 778/1550] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.168150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe0f1-5108-4423-a6af-75333448d8d0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.168436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe0f1-5108-4423-a6af-75333448d8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.168705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe0f1-5108-4423-a6af-75333448d8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.192198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6e1fe0f1-5108-4423-a6af-75333448d8d0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.193395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e1fe0f1-5108-4423-a6af-75333448d8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.230828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc04ad8-e641-4adb-837f-f949471a62ac admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.237202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf2065-848c-45f4-b339-65330c048c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.237870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf2065-848c-45f4-b339-65330c048c54 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.238144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf2065-848c-45f4-b339-65330c048c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.238417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf2065-848c-45f4-b339-65330c048c54 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.239071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf2065-848c-45f4-b339-65330c048c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.240981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf2065-848c-45f4-b339-65330c048c54 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.252867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 779/1551] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.255097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d590c-e05f-4db0-8d88-3a000321b68f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.255385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d590c-e05f-4db0-8d88-3a000321b68f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.255661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d590c-e05f-4db0-8d88-3a000321b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.273266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 773/1552] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:14.273266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf2065-848c-45f4-b339-65330c048c54 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.276271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0a7d590c-e05f-4db0-8d88-3a000321b68f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.277459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0a7d590c-e05f-4db0-8d88-3a000321b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.283195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf2065-848c-45f4-b339-65330c048c54 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.285601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 780/1553] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.286946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7321698-13c4-47aa-b26e-a398e6e3f055 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.287226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7321698-13c4-47aa-b26e-a398e6e3f055 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.287500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7321698-13c4-47aa-b26e-a398e6e3f055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.288910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e683ef7-19a1-48dc-8a51-75b9581aecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.289516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e683ef7-19a1-48dc-8a51-75b9581aecb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.289797 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e683ef7-19a1-48dc-8a51-75b9581aecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.290142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e683ef7-19a1-48dc-8a51-75b9581aecb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.290899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e683ef7-19a1-48dc-8a51-75b9581aecb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.292848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e683ef7-19a1-48dc-8a51-75b9581aecb0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.306423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b7321698-13c4-47aa-b26e-a398e6e3f055 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.307673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b7321698-13c4-47aa-b26e-a398e6e3f055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.318187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 774/1554] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:14.318187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e683ef7-19a1-48dc-8a51-75b9581aecb0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.318857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 781/1555] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.324158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ba7d3-d390-4b85-bea6-1559271b5b0a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.324449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ba7d3-d390-4b85-bea6-1559271b5b0a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.324779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ba7d3-d390-4b85-bea6-1559271b5b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.328194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e683ef7-19a1-48dc-8a51-75b9581aecb0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.334564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf1b29-9f62-4820-bee9-57b722ca4745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.334564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf1b29-9f62-4820-bee9-57b722ca4745 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.334843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf1b29-9f62-4820-bee9-57b722ca4745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.335085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf1b29-9f62-4820-bee9-57b722ca4745 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.335716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf1b29-9f62-4820-bee9-57b722ca4745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:14.336017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf1b29-9f62-4820-bee9-57b722ca4745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.337603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf1b29-9f62-4820-bee9-57b722ca4745 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.345123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:14.345314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f47ba7d3-d390-4b85-bea6-1559271b5b0a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.346566 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f47ba7d3-d390-4b85-bea6-1559271b5b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.356220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 782/1556] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.358631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 775/1557] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:14.360002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88511cae-0625-42d4-8a83-942ae9365de9 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.360289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88511cae-0625-42d4-8a83-942ae9365de9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.360565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88511cae-0625-42d4-8a83-942ae9365de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.364193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efb045-8a32-475e-b040-5288753dbc33 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.364542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efb045-8a32-475e-b040-5288753dbc33 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.364846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efb045-8a32-475e-b040-5288753dbc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.380638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-88511cae-0625-42d4-8a83-942ae9365de9 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.381839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-88511cae-0625-42d4-8a83-942ae9365de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.384096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-44efb045-8a32-475e-b040-5288753dbc33 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.385244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-44efb045-8a32-475e-b040-5288753dbc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.389799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 776/1558] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.390559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88511cae-0625-42d4-8a83-942ae9365de9 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.393460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 783/1559] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.394712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efb045-8a32-475e-b040-5288753dbc33 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.401788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88511cae-0625-42d4-8a83-942ae9365de9 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.404029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efb045-8a32-475e-b040-5288753dbc33 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.406391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8bbfe-38a9-414c-9b19-101bd97187aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.407020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8bbfe-38a9-414c-9b19-101bd97187aa admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.407304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8bbfe-38a9-414c-9b19-101bd97187aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.407578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8bbfe-38a9-414c-9b19-101bd97187aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.408220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8bbfe-38a9-414c-9b19-101bd97187aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.408542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aca210-cef6-4d05-9911-eeec2057bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.409129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aca210-cef6-4d05-9911-eeec2057bd31 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.409435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aca210-cef6-4d05-9911-eeec2057bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.409702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aca210-cef6-4d05-9911-eeec2057bd31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.409864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8bbfe-38a9-414c-9b19-101bd97187aa admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.410334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aca210-cef6-4d05-9911-eeec2057bd31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:14.410632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aca210-cef6-4d05-9911-eeec2057bd31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.412247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aca210-cef6-4d05-9911-eeec2057bd31 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.420095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 777/1560] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:14.420745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8bbfe-38a9-414c-9b19-101bd97187aa admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.423942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 784/1561] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:14.425525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c637f-92b2-44be-add3-126400c0c487 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.425805 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c637f-92b2-44be-add3-126400c0c487 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.426075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c637f-92b2-44be-add3-126400c0c487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.432273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8bbfe-38a9-414c-9b19-101bd97187aa admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.436839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0252b-ef69-4cf7-b0f6-4950ea8c8aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.437428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0252b-ef69-4cf7-b0f6-4950ea8c8aab admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.437711 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0252b-ef69-4cf7-b0f6-4950ea8c8aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.437982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0252b-ef69-4cf7-b0f6-4950ea8c8aab admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.438614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0252b-ef69-4cf7-b0f6-4950ea8c8aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.440237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0252b-ef69-4cf7-b0f6-4950ea8c8aab admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.448698 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-be7c637f-92b2-44be-add3-126400c0c487 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.449874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be7c637f-92b2-44be-add3-126400c0c487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.450612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 778/1562] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:14.451273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0252b-ef69-4cf7-b0f6-4950ea8c8aab admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.459003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 785/1563] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.460161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e4456-ffe7-469a-8aad-89170e2668cd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.460446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e4456-ffe7-469a-8aad-89170e2668cd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.460717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e4456-ffe7-469a-8aad-89170e2668cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.461761 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0252b-ef69-4cf7-b0f6-4950ea8c8aab admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.466722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e0b43-77b1-4ac9-ab17-8386cbdda461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.467305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e0b43-77b1-4ac9-ab17-8386cbdda461 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.467586 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e0b43-77b1-4ac9-ab17-8386cbdda461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.467866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e0b43-77b1-4ac9-ab17-8386cbdda461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.468491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e0b43-77b1-4ac9-ab17-8386cbdda461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.469705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:14.470451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e0b43-77b1-4ac9-ab17-8386cbdda461 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.480902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-337e4456-ffe7-469a-8aad-89170e2668cd None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.482092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-337e4456-ffe7-469a-8aad-89170e2668cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.491317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 786/1564] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.492099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e4456-ffe7-469a-8aad-89170e2668cd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.501394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e4456-ffe7-469a-8aad-89170e2668cd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.506014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 779/1565] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:14.506014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca04fc4-2425-446b-ad90-aed1a561dc7f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.506014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca04fc4-2425-446b-ad90-aed1a561dc7f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.506014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca04fc4-2425-446b-ad90-aed1a561dc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.524218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4ca04fc4-2425-446b-ad90-aed1a561dc7f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:14.525407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4ca04fc4-2425-446b-ad90-aed1a561dc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:14.564803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240875d2-f94e-4138-8568-a65ddf498e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.566282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240875d2-f94e-4138-8568-a65ddf498e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.566822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240875d2-f94e-4138-8568-a65ddf498e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.567266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240875d2-f94e-4138-8568-a65ddf498e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.568236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240875d2-f94e-4138-8568-a65ddf498e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:14.568661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240875d2-f94e-4138-8568-a65ddf498e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.570757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240875d2-f94e-4138-8568-a65ddf498e22 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.590136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 787/1566] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:14.590136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240875d2-f94e-4138-8568-a65ddf498e22 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.590429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 780/1567] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:14.590429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca04fc4-2425-446b-ad90-aed1a561dc7f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.595727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240875d2-f94e-4138-8568-a65ddf498e22 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.598331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca04fc4-2425-446b-ad90-aed1a561dc7f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.600710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de1bf9-89bb-4956-92b1-7583698f254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.601371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de1bf9-89bb-4956-92b1-7583698f254e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.601664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de1bf9-89bb-4956-92b1-7583698f254e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.601933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de1bf9-89bb-4956-92b1-7583698f254e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.602567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de1bf9-89bb-4956-92b1-7583698f254e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.602825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e0c62-b5cd-4c9b-ae36-926c94cb5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.603409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e0c62-b5cd-4c9b-ae36-926c94cb5f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.603684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e0c62-b5cd-4c9b-ae36-926c94cb5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.603952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e0c62-b5cd-4c9b-ae36-926c94cb5f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.604273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de1bf9-89bb-4956-92b1-7583698f254e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.604575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e0c62-b5cd-4c9b-ae36-926c94cb5f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.606509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e0c62-b5cd-4c9b-ae36-926c94cb5f41 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.615853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 788/1568] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:14.616664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de1bf9-89bb-4956-92b1-7583698f254e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.626235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de1bf9-89bb-4956-92b1-7583698f254e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.632536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30139b4e-0231-490b-92f1-da50b70b919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.633132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30139b4e-0231-490b-92f1-da50b70b919d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.633419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30139b4e-0231-490b-92f1-da50b70b919d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.633696 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30139b4e-0231-490b-92f1-da50b70b919d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.634333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30139b4e-0231-490b-92f1-da50b70b919d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.636048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30139b4e-0231-490b-92f1-da50b70b919d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.637596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 781/1569] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:14.638902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e0c62-b5cd-4c9b-ae36-926c94cb5f41 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.646501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 789/1570] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:14.647366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30139b4e-0231-490b-92f1-da50b70b919d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.658217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30139b4e-0231-490b-92f1-da50b70b919d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.707541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e0c62-b5cd-4c9b-ae36-926c94cb5f41 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.712363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5fce9-56ff-4521-a255-e26972086b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.712970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5fce9-56ff-4521-a255-e26972086b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.713249 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5fce9-56ff-4521-a255-e26972086b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.713521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5fce9-56ff-4521-a255-e26972086b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.714166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5fce9-56ff-4521-a255-e26972086b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:14.714468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5fce9-56ff-4521-a255-e26972086b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.716111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5fce9-56ff-4521-a255-e26972086b6b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.723379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c208-9d80-46ef-abe2-38994726538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.724048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c208-9d80-46ef-abe2-38994726538a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.724270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c208-9d80-46ef-abe2-38994726538a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.724539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c208-9d80-46ef-abe2-38994726538a admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.725183 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43c208-9d80-46ef-abe2-38994726538a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:14.725492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43c208-9d80-46ef-abe2-38994726538a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.727117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43c208-9d80-46ef-abe2-38994726538a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.734931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 782/1571] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:14.734931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5fce9-56ff-4521-a255-e26972086b6b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.741239 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5fce9-56ff-4521-a255-e26972086b6b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.745328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 790/1572] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:14.746132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c208-9d80-46ef-abe2-38994726538a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.753609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de571c-d2ca-4682-9339-b1784326601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.754385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de571c-d2ca-4682-9339-b1784326601b admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.754500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de571c-d2ca-4682-9339-b1784326601b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.754792 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de571c-d2ca-4682-9339-b1784326601b admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.755420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de571c-d2ca-4682-9339-b1784326601b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.757336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de571c-d2ca-4682-9339-b1784326601b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.758334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c208-9d80-46ef-abe2-38994726538a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.763061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e2944-302a-46a0-aa34-77ecd4a022eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.763644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2944-302a-46a0-aa34-77ecd4a022eb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.763925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2944-302a-46a0-aa34-77ecd4a022eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.764194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2944-302a-46a0-aa34-77ecd4a022eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.764809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e2944-302a-46a0-aa34-77ecd4a022eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.767630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e2944-302a-46a0-aa34-77ecd4a022eb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.779094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 783/1573] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:14.779976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de571c-d2ca-4682-9339-b1784326601b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.785433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:14.790440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de571c-d2ca-4682-9339-b1784326601b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.796487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f4545-8aec-4e8b-90aa-38a6a0ff5341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.797082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4545-8aec-4e8b-90aa-38a6a0ff5341 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.797359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4545-8aec-4e8b-90aa-38a6a0ff5341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.797628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4545-8aec-4e8b-90aa-38a6a0ff5341 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.798269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f4545-8aec-4e8b-90aa-38a6a0ff5341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:14.798566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f4545-8aec-4e8b-90aa-38a6a0ff5341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.803359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 791/1574] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:14.803534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f4545-8aec-4e8b-90aa-38a6a0ff5341 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.803720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e2944-302a-46a0-aa34-77ecd4a022eb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.818143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 784/1575] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:14.818143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f4545-8aec-4e8b-90aa-38a6a0ff5341 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.826012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f4545-8aec-4e8b-90aa-38a6a0ff5341 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.851747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:14.870833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e2944-302a-46a0-aa34-77ecd4a022eb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.875866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe27181-2cdb-403f-aade-1927b397755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.876529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe27181-2cdb-403f-aade-1927b397755d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.876817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe27181-2cdb-403f-aade-1927b397755d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.877094 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe27181-2cdb-403f-aade-1927b397755d admin admin] PATH_INFO: `/v3/projects/6eae29572cf24e44b34dbd43e6207a42/users/439521dcf005417cb22a80dc340312ab/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.884276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f51966-0448-442d-92eb-691162b240f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.884879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f51966-0448-442d-92eb-691162b240f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.885155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f51966-0448-442d-92eb-691162b240f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.885451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f51966-0448-442d-92eb-691162b240f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.886088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f51966-0448-442d-92eb-691162b240f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.888046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f51966-0448-442d-92eb-691162b240f2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.891265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe27181-2cdb-403f-aade-1927b397755d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eae29572cf24e44b34dbd43e6207a42, user_id=439521dcf005417cb22a80dc340312ab, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.893970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe27181-2cdb-403f-aade-1927b397755d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.908124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 792/1576] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:14 2022] PUT /identity/v3/projects/6eae29572cf24e44b34dbd43e6207a42/users/439521dcf005417cb22a80dc340312ab/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:14.908912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe27181-2cdb-403f-aade-1927b397755d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.910415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 785/1577] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:14.911116 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f51966-0448-442d-92eb-691162b240f2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:14.921358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f51966-0448-442d-92eb-691162b240f2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.974389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe27181-2cdb-403f-aade-1927b397755d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:14.979394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5521c-33cc-4f85-a01b-2ced64204ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.979739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f79c-3d49-4cc7-882f-b38033ea6ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:14.980064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5521c-33cc-4f85-a01b-2ced64204ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.980346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f79c-3d49-4cc7-882f-b38033ea6ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:14.980455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5521c-33cc-4f85-a01b-2ced64204ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.980628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f79c-3d49-4cc7-882f-b38033ea6ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:14.980734 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5521c-33cc-4f85-a01b-2ced64204ff0 admin admin] PATH_INFO: `/v3/projects/18f60090892b42a297ccdda9a80bd4e5/users/1479ebe2a7a7426d9ee1dafa37fbd0b0/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.980899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f79c-3d49-4cc7-882f-b38033ea6ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:14.981613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918f79c-3d49-4cc7-882f-b38033ea6ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:14.985114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918f79c-3d49-4cc7-882f-b38033ea6ea4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:14.997218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5521c-33cc-4f85-a01b-2ced64204ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f60090892b42a297ccdda9a80bd4e5, user_id=1479ebe2a7a7426d9ee1dafa37fbd0b0, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.000490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5521c-33cc-4f85-a01b-2ced64204ff0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.014642 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 793/1578] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:14 2022] PUT /identity/v3/projects/18f60090892b42a297ccdda9a80bd4e5/users/1479ebe2a7a7426d9ee1dafa37fbd0b0/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:15.018391 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5521c-33cc-4f85-a01b-2ced64204ff0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.021551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 786/1579] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:14 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:15.022840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f79c-3d49-4cc7-882f-b38033ea6ea4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.082801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5521c-33cc-4f85-a01b-2ced64204ff0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.087558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330685d-f994-4a96-9cf0-bbea4f186e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.088157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330685d-f994-4a96-9cf0-bbea4f186e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.088432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330685d-f994-4a96-9cf0-bbea4f186e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.088550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f79c-3d49-4cc7-882f-b38033ea6ea4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.088706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330685d-f994-4a96-9cf0-bbea4f186e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.089330 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330685d-f994-4a96-9cf0-bbea4f186e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.091279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330685d-f994-4a96-9cf0-bbea4f186e5e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.093212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc74e24-56c8-4353-9e56-eaa5806090dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.093815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc74e24-56c8-4353-9e56-eaa5806090dc admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.094095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc74e24-56c8-4353-9e56-eaa5806090dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.094377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc74e24-56c8-4353-9e56-eaa5806090dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.095054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc74e24-56c8-4353-9e56-eaa5806090dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.096650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc74e24-56c8-4353-9e56-eaa5806090dc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.102464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:15.108064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 787/1580] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.109261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc74e24-56c8-4353-9e56-eaa5806090dc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.120481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 794/1581] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:15.120722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc74e24-56c8-4353-9e56-eaa5806090dc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.121811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330685d-f994-4a96-9cf0-bbea4f186e5e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.156972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:15.182015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe2611-fb58-4201-afe6-c336a0550be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.182625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2611-fb58-4201-afe6-c336a0550be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.182937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2611-fb58-4201-afe6-c336a0550be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.183211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2611-fb58-4201-afe6-c336a0550be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.183851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe2611-fb58-4201-afe6-c336a0550be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.185775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe2611-fb58-4201-afe6-c336a0550be3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.187458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330685d-f994-4a96-9cf0-bbea4f186e5e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.192781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56c6a0-83c9-413d-8641-3974b827ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.193384 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56c6a0-83c9-413d-8641-3974b827ab54 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.193662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56c6a0-83c9-413d-8641-3974b827ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.193936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56c6a0-83c9-413d-8641-3974b827ab54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.194555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56c6a0-83c9-413d-8641-3974b827ab54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.196498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56c6a0-83c9-413d-8641-3974b827ab54 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.210854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 788/1582] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:15.210854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe2611-fb58-4201-afe6-c336a0550be3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.219158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe2611-fb58-4201-afe6-c336a0550be3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.224257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1360a7-f9a5-4149-a1f9-a2c9c459923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.224855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1360a7-f9a5-4149-a1f9-a2c9c459923c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.225136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1360a7-f9a5-4149-a1f9-a2c9c459923c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.225411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1360a7-f9a5-4149-a1f9-a2c9c459923c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.226049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1360a7-f9a5-4149-a1f9-a2c9c459923c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.227695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1360a7-f9a5-4149-a1f9-a2c9c459923c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.227822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 795/1583] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:15.229177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a437-8135-4728-bbe0-f2ae301f4245 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.229461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a437-8135-4728-bbe0-f2ae301f4245 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.229730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a437-8135-4728-bbe0-f2ae301f4245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.242635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 789/1584] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.242635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf2f42-43ff-46e7-8ee5-958e2b388def None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.242635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf2f42-43ff-46e7-8ee5-958e2b388def None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.242635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf2f42-43ff-46e7-8ee5-958e2b388def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.249511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1360a437-8135-4728-bbe0-f2ae301f4245 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:15.250722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1360a437-8135-4728-bbe0-f2ae301f4245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:15.260389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6dcf2f42-43ff-46e7-8ee5-958e2b388def None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:15.261560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6dcf2f42-43ff-46e7-8ee5-958e2b388def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:15.309361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 796/1585] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:15.310338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360a437-8135-4728-bbe0-f2ae301f4245 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.321963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360a437-8135-4728-bbe0-f2ae301f4245 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.328807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 790/1586] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:15.328807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf2f42-43ff-46e7-8ee5-958e2b388def None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.331435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848cac6-3f47-4efd-a397-438eca869f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.332655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848cac6-3f47-4efd-a397-438eca869f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.333828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848cac6-3f47-4efd-a397-438eca869f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.334548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848cac6-3f47-4efd-a397-438eca869f16 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.335820 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848cac6-3f47-4efd-a397-438eca869f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.336889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-f848cac6-3f47-4efd-a397-438eca869f16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:34:15.336889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 31 11:34:15.336889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: Aug 31 11:34:15.337196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf2f42-43ff-46e7-8ee5-958e2b388def None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.338087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848cac6-3f47-4efd-a397-438eca869f16 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.342560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa4df0-d55b-4fe6-9092-a959bb5fed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.343072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa4df0-d55b-4fe6-9092-a959bb5fed58 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.343426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa4df0-d55b-4fe6-9092-a959bb5fed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.343776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa4df0-d55b-4fe6-9092-a959bb5fed58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.344427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa4df0-d55b-4fe6-9092-a959bb5fed58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.346147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa4df0-d55b-4fe6-9092-a959bb5fed58 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.358904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 791/1587] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.359522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa4df0-d55b-4fe6-9092-a959bb5fed58 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.364511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 797/1588] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:15.364511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848cac6-3f47-4efd-a397-438eca869f16 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.369933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa4df0-d55b-4fe6-9092-a959bb5fed58 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.373662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848cac6-3f47-4efd-a397-438eca869f16 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.374578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13672bbb-59dd-43bf-9c23-95f51a8a2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.375206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13672bbb-59dd-43bf-9c23-95f51a8a2309 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.375487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13672bbb-59dd-43bf-9c23-95f51a8a2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.375756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13672bbb-59dd-43bf-9c23-95f51a8a2309 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.376382 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13672bbb-59dd-43bf-9c23-95f51a8a2309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.378854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e21dab-bc0e-4424-baf3-9bcb3020d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.379227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13672bbb-59dd-43bf-9c23-95f51a8a2309 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.379446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e21dab-bc0e-4424-baf3-9bcb3020d1da admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.379721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e21dab-bc0e-4424-baf3-9bcb3020d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.379997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e21dab-bc0e-4424-baf3-9bcb3020d1da admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.380632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e21dab-bc0e-4424-baf3-9bcb3020d1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.382226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e21dab-bc0e-4424-baf3-9bcb3020d1da admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.392941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 798/1589] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.393738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e21dab-bc0e-4424-baf3-9bcb3020d1da admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.401595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 792/1590] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:15.402428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13672bbb-59dd-43bf-9c23-95f51a8a2309 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.403390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e21dab-bc0e-4424-baf3-9bcb3020d1da admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.408069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34869d7f-fbf3-4f62-871c-1154bad34dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.408656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869d7f-fbf3-4f62-871c-1154bad34dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.408933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869d7f-fbf3-4f62-871c-1154bad34dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.409231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869d7f-fbf3-4f62-871c-1154bad34dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.410146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34869d7f-fbf3-4f62-871c-1154bad34dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.412098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34869d7f-fbf3-4f62-871c-1154bad34dd7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.413481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13672bbb-59dd-43bf-9c23-95f51a8a2309 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.418278 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220297-2e4d-419c-8f0d-f3111f3a8cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.418953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220297-2e4d-419c-8f0d-f3111f3a8cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.419335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220297-2e4d-419c-8f0d-f3111f3a8cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.419612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220297-2e4d-419c-8f0d-f3111f3a8cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.420248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e220297-2e4d-419c-8f0d-f3111f3a8cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.421844 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e220297-2e4d-419c-8f0d-f3111f3a8cb6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.433886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 793/1591] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.434863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220297-2e4d-419c-8f0d-f3111f3a8cb6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.437066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 799/1592] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:15.437775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34869d7f-fbf3-4f62-871c-1154bad34dd7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.479661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:15.493291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34869d7f-fbf3-4f62-871c-1154bad34dd7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.494575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220297-2e4d-419c-8f0d-f3111f3a8cb6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.496963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab462b4-0c08-44e8-bc1f-faef8ba92490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.497570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab462b4-0c08-44e8-bc1f-faef8ba92490 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.497846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab462b4-0c08-44e8-bc1f-faef8ba92490 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.498119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab462b4-0c08-44e8-bc1f-faef8ba92490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.498425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fb59c-658c-4573-a109-9f6931ea9390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.499072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fb59c-658c-4573-a109-9f6931ea9390 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.499342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fb59c-658c-4573-a109-9f6931ea9390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.499606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fb59c-658c-4573-a109-9f6931ea9390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.507622 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab462b4-0c08-44e8-bc1f-faef8ba92490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.509058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab462b4-0c08-44e8-bc1f-faef8ba92490 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.509172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fb59c-658c-4573-a109-9f6931ea9390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.510469 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fb59c-658c-4573-a109-9f6931ea9390 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.518567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 800/1593] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:15.519453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab462b4-0c08-44e8-bc1f-faef8ba92490 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.520379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 794/1594] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:15.521197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fb59c-658c-4573-a109-9f6931ea9390 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.529001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab462b4-0c08-44e8-bc1f-faef8ba92490 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.531664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fb59c-658c-4573-a109-9f6931ea9390 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.533818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b079d25-1299-4b97-869d-44f8406c37c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.534444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b079d25-1299-4b97-869d-44f8406c37c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.534745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b079d25-1299-4b97-869d-44f8406c37c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.535020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b079d25-1299-4b97-869d-44f8406c37c2 admin admin] PATH_INFO: `/v3/projects/09649d971871400ba9611cbfad32513b/users/09e1a58dc35c49d4b5cccd6d91b9ef47/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.536765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe5df-53d4-4afa-aecd-d8639d524a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.537430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe5df-53d4-4afa-aecd-d8639d524a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.537781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe5df-53d4-4afa-aecd-d8639d524a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.538124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe5df-53d4-4afa-aecd-d8639d524a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.538882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfe5df-53d4-4afa-aecd-d8639d524a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.540685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfe5df-53d4-4afa-aecd-d8639d524a53 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.548573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:15.551774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 795/1595] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.552754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe5df-53d4-4afa-aecd-d8639d524a53 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.553718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b079d25-1299-4b97-869d-44f8406c37c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09649d971871400ba9611cbfad32513b, user_id=09e1a58dc35c49d4b5cccd6d91b9ef47, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.557668 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b079d25-1299-4b97-869d-44f8406c37c2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.563130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe5df-53d4-4afa-aecd-d8639d524a53 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.569440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978c443-2c36-425c-a4ec-1c618de371de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.570321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978c443-2c36-425c-a4ec-1c618de371de admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.570638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978c443-2c36-425c-a4ec-1c618de371de admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.571087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978c443-2c36-425c-a4ec-1c618de371de admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.571731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978c443-2c36-425c-a4ec-1c618de371de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.573337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978c443-2c36-425c-a4ec-1c618de371de admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.585838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 801/1596] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:15 2022] PUT /identity/v3/projects/09649d971871400ba9611cbfad32513b/users/09e1a58dc35c49d4b5cccd6d91b9ef47/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:15.585838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b079d25-1299-4b97-869d-44f8406c37c2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.586200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 796/1597] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.586200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978c443-2c36-425c-a4ec-1c618de371de admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.595568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978c443-2c36-425c-a4ec-1c618de371de admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.660277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605a93b-caca-4042-ac55-95d14e0dd5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.661273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a93b-caca-4042-ac55-95d14e0dd5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.661273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a93b-caca-4042-ac55-95d14e0dd5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.661654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a93b-caca-4042-ac55-95d14e0dd5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.662121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b079d25-1299-4b97-869d-44f8406c37c2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.662439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605a93b-caca-4042-ac55-95d14e0dd5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.664510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605a93b-caca-4042-ac55-95d14e0dd5a0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.667181 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021467-faef-4cdb-905b-e473d439d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.667842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021467-faef-4cdb-905b-e473d439d8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.668125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021467-faef-4cdb-905b-e473d439d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.668395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021467-faef-4cdb-905b-e473d439d8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.669184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6021467-faef-4cdb-905b-e473d439d8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.671005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6021467-faef-4cdb-905b-e473d439d8f9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.680355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 797/1598] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.681537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605a93b-caca-4042-ac55-95d14e0dd5a0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.684351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 802/1599] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.685404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021467-faef-4cdb-905b-e473d439d8f9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.701612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605a93b-caca-4042-ac55-95d14e0dd5a0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.703571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021467-faef-4cdb-905b-e473d439d8f9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.707748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087eb7-e2a4-4596-b3e3-360d229d2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.708582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087eb7-e2a4-4596-b3e3-360d229d2671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.708964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087eb7-e2a4-4596-b3e3-360d229d2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.709374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087eb7-e2a4-4596-b3e3-360d229d2671 admin admin] PATH_INFO: `/v3/projects/09cf6cd7e1704b069d00447b246133fd/users/a7c9275aeee8438fa1fde55f207fd730/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.710211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d27f6-76a3-4b81-a1df-0cd6b47b0768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.711295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d27f6-76a3-4b81-a1df-0cd6b47b0768 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.711806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d27f6-76a3-4b81-a1df-0cd6b47b0768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.712247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d27f6-76a3-4b81-a1df-0cd6b47b0768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.713169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d27f6-76a3-4b81-a1df-0cd6b47b0768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.715150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d27f6-76a3-4b81-a1df-0cd6b47b0768 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.727673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087eb7-e2a4-4596-b3e3-360d229d2671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cf6cd7e1704b069d00447b246133fd, user_id=a7c9275aeee8438fa1fde55f207fd730, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.728794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-3a087eb7-e2a4-4596-b3e3-360d229d2671 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:34:15.728794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: warnings.warn(msg) Aug 31 11:34:15.728794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: Aug 31 11:34:15.729174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 803/1600] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.731551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051619b-3316-406d-aec0-10848776e9e4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.732105 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051619b-3316-406d-aec0-10848776e9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.732850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051619b-3316-406d-aec0-10848776e9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.734603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087eb7-e2a4-4596-b3e3-360d229d2671 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.758312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 798/1601] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:15 2022] PUT /identity/v3/projects/09cf6cd7e1704b069d00447b246133fd/users/a7c9275aeee8438fa1fde55f207fd730/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:15.758573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b051619b-3316-406d-aec0-10848776e9e4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:15.759194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087eb7-e2a4-4596-b3e3-360d229d2671 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.760309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b051619b-3316-406d-aec0-10848776e9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:15.834652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 804/1602] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:15.834652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051619b-3316-406d-aec0-10848776e9e4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.838528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087eb7-e2a4-4596-b3e3-360d229d2671 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.849062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a69a50-2037-45af-9e3c-9dfcf80eac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.849905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051619b-3316-406d-aec0-10848776e9e4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.850400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a69a50-2037-45af-9e3c-9dfcf80eac71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.850960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a69a50-2037-45af-9e3c-9dfcf80eac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.851530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a69a50-2037-45af-9e3c-9dfcf80eac71 admin admin] PATH_INFO: `/v3/projects/006e454e548446b7b62a83d4045af3c2/users/d1a62b20b68c472badbfe82a2063fcb8/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.854714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b879d-551d-4880-a42e-a654267e8866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.855310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b879d-551d-4880-a42e-a654267e8866 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.855587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b879d-551d-4880-a42e-a654267e8866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.855859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b879d-551d-4880-a42e-a654267e8866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.856495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b879d-551d-4880-a42e-a654267e8866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.858383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b879d-551d-4880-a42e-a654267e8866 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.870731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 805/1603] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.871320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b879d-551d-4880-a42e-a654267e8866 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.882928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a69a50-2037-45af-9e3c-9dfcf80eac71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006e454e548446b7b62a83d4045af3c2, user_id=d1a62b20b68c472badbfe82a2063fcb8, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.885415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b879d-551d-4880-a42e-a654267e8866 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.885708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a69a50-2037-45af-9e3c-9dfcf80eac71 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.890999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7d472-285e-4f21-8647-d6a54969eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.891650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7d472-285e-4f21-8647-d6a54969eb5d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.891913 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7d472-285e-4f21-8647-d6a54969eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.892192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7d472-285e-4f21-8647-d6a54969eb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.892837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7d472-285e-4f21-8647-d6a54969eb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:15.895222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7d472-285e-4f21-8647-d6a54969eb5d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:15.908512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 799/1604] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:15 2022] PUT /identity/v3/projects/006e454e548446b7b62a83d4045af3c2/users/d1a62b20b68c472badbfe82a2063fcb8/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:15.908512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a69a50-2037-45af-9e3c-9dfcf80eac71 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:15.913445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 806/1605] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:15.916690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d757-758a-4b55-a5b5-b0cb50972185 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.917096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d757-758a-4b55-a5b5-b0cb50972185 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.917449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d757-758a-4b55-a5b5-b0cb50972185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:15.933097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:15.947393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9958d757-758a-4b55-a5b5-b0cb50972185 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:15.948667 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9958d757-758a-4b55-a5b5-b0cb50972185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:15.988842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a69a50-2037-45af-9e3c-9dfcf80eac71 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:15.994184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5bc21-18d1-4461-8fea-d86929a16b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:15.995330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5bc21-18d1-4461-8fea-d86929a16b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:15.995646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5bc21-18d1-4461-8fea-d86929a16b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:15.995885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5bc21-18d1-4461-8fea-d86929a16b66 admin admin] PATH_INFO: `/v3/projects/46086fc0b16346d086be7469d20f6c8f/users/cfacb5f74eb8454bb9ae8adb349b7383/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.007339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:16.015219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5bc21-18d1-4461-8fea-d86929a16b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46086fc0b16346d086be7469d20f6c8f, user_id=cfacb5f74eb8454bb9ae8adb349b7383, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:16.017975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5bc21-18d1-4461-8fea-d86929a16b66 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:16.034787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 807/1606] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:16.036571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d757-758a-4b55-a5b5-b0cb50972185 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:16.037364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 800/1607] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:15 2022] PUT /identity/v3/projects/46086fc0b16346d086be7469d20f6c8f/users/cfacb5f74eb8454bb9ae8adb349b7383/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:16.038290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5bc21-18d1-4461-8fea-d86929a16b66 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:16.048659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9958d757-758a-4b55-a5b5-b0cb50972185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:16.118461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5bc21-18d1-4461-8fea-d86929a16b66 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:16.121376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d757-758a-4b55-a5b5-b0cb50972185 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:16.123740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe10f0-bab7-4fd7-a972-c98691ffc404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:16.124404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe10f0-bab7-4fd7-a972-c98691ffc404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.124682 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe10f0-bab7-4fd7-a972-c98691ffc404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.124951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe10f0-bab7-4fd7-a972-c98691ffc404 admin admin] PATH_INFO: `/v3/projects/319223809f454b9491a981dc8fcef22b/users/8f9b3ddbad3943e68668332610615ff4/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.142213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe10f0-bab7-4fd7-a972-c98691ffc404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319223809f454b9491a981dc8fcef22b, user_id=8f9b3ddbad3943e68668332610615ff4, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:16.145091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe10f0-bab7-4fd7-a972-c98691ffc404 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:16.161150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 801/1608] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:16 2022] PUT /identity/v3/projects/319223809f454b9491a981dc8fcef22b/users/8f9b3ddbad3943e68668332610615ff4/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:16.162658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20421aa4-2ff6-408f-bfb0-662aa13740bb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.163132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20421aa4-2ff6-408f-bfb0-662aa13740bb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.163632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20421aa4-2ff6-408f-bfb0-662aa13740bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.196269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-20421aa4-2ff6-408f-bfb0-662aa13740bb None None] MFA Rules not processed for user `d1a62b20b68c472badbfe82a2063fcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:16.198856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-20421aa4-2ff6-408f-bfb0-662aa13740bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:16.201616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3f8dd-3fc8-4100-b311-8c6ee5e6b818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:16.202455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3f8dd-3fc8-4100-b311-8c6ee5e6b818 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.202777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3f8dd-3fc8-4100-b311-8c6ee5e6b818 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.203055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3f8dd-3fc8-4100-b311-8c6ee5e6b818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.216902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3f8dd-3fc8-4100-b311-8c6ee5e6b818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:16.218858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3f8dd-3fc8-4100-b311-8c6ee5e6b818 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:16.234964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 808/1609] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:16.235933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3f8dd-3fc8-4100-b311-8c6ee5e6b818 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:16.274147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3f8dd-3fc8-4100-b311-8c6ee5e6b818 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:16.308892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 802/1610] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:16.310383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20421aa4-2ff6-408f-bfb0-662aa13740bb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:16.326503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:16.410081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20421aa4-2ff6-408f-bfb0-662aa13740bb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:16.422286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ffe9b-42fe-4f3a-8434-35c102912990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:16.423495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ffe9b-42fe-4f3a-8434-35c102912990 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.424619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ffe9b-42fe-4f3a-8434-35c102912990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.425796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ffe9b-42fe-4f3a-8434-35c102912990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.426454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ab310-a7df-4235-a26c-3d2d06d3d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:16.427735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ab310-a7df-4235-a26c-3d2d06d3d5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.428164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ab310-a7df-4235-a26c-3d2d06d3d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.428608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ab310-a7df-4235-a26c-3d2d06d3d5c0 admin admin] PATH_INFO: `/v3/projects/16cb889cd2f84b679d5d559746f51330/users/6e7cab3cddc64595a58bc642af5c47ff/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.451132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ab310-a7df-4235-a26c-3d2d06d3d5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cb889cd2f84b679d5d559746f51330, user_id=6e7cab3cddc64595a58bc642af5c47ff, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:16.455791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ab310-a7df-4235-a26c-3d2d06d3d5c0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:16.475047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ffe9b-42fe-4f3a-8434-35c102912990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:16.476551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ffe9b-42fe-4f3a-8434-35c102912990 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:16.482343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 809/1611] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:16 2022] PUT /identity/v3/projects/16cb889cd2f84b679d5d559746f51330/users/6e7cab3cddc64595a58bc642af5c47ff/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:16.484293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931be5d-4054-4bfa-b718-b5912fcd38f1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.484684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931be5d-4054-4bfa-b718-b5912fcd38f1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.485104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931be5d-4054-4bfa-b718-b5912fcd38f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.504962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 803/1612] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:16.506078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80bed-a77b-46cd-bc6b-a945f30c28cd None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.506365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80bed-a77b-46cd-bc6b-a945f30c28cd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.506640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80bed-a77b-46cd-bc6b-a945f30c28cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.551129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6ab80bed-a77b-46cd-bc6b-a945f30c28cd None None] MFA Rules not processed for user `8f9b3ddbad3943e68668332610615ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:16.552418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6ab80bed-a77b-46cd-bc6b-a945f30c28cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:16.583736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7931be5d-4054-4bfa-b718-b5912fcd38f1 None None] MFA Rules not processed for user `cfacb5f74eb8454bb9ae8adb349b7383`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:16.589347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7931be5d-4054-4bfa-b718-b5912fcd38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:16.653331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 804/1613] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:16.654444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab80bed-a77b-46cd-bc6b-a945f30c28cd None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:16.675656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:16.747875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab80bed-a77b-46cd-bc6b-a945f30c28cd None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:16.757926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201f3fc-4c7f-4584-b28f-3242b86cf2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:16.758640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201f3fc-4c7f-4584-b28f-3242b86cf2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.758974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201f3fc-4c7f-4584-b28f-3242b86cf2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.759247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201f3fc-4c7f-4584-b28f-3242b86cf2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.759965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201f3fc-4c7f-4584-b28f-3242b86cf2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:16.763161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201f3fc-4c7f-4584-b28f-3242b86cf2d1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:16.794630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 810/1614] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:16.795683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb8a6a-4fab-4c68-897a-7536a1d0391e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.795967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb8a6a-4fab-4c68-897a-7536a1d0391e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.796239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb8a6a-4fab-4c68-897a-7536a1d0391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.809207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 805/1615] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:16 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:16.810100 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201f3fc-4c7f-4584-b28f-3242b86cf2d1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:16.854958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-74eb8a6a-4fab-4c68-897a-7536a1d0391e None None] MFA Rules not processed for user `6e7cab3cddc64595a58bc642af5c47ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:16.856182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-74eb8a6a-4fab-4c68-897a-7536a1d0391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:16.887626 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:16.919429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201f3fc-4c7f-4584-b28f-3242b86cf2d1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:16.924072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c0f29-44e2-4b02-9f56-8fe9b078464b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:16.924742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c0f29-44e2-4b02-9f56-8fe9b078464b service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:16.925061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c0f29-44e2-4b02-9f56-8fe9b078464b service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:16.925408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c0f29-44e2-4b02-9f56-8fe9b078464b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:16.960457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 811/1616] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:16.961406 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb8a6a-4fab-4c68-897a-7536a1d0391e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:16.995881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c0f29-44e2-4b02-9f56-8fe9b078464b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:16.997865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c0f29-44e2-4b02-9f56-8fe9b078464b service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.009511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 806/1617] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:17.011021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae3700-4949-443d-bb6b-8963301de248 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.011521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae3700-4949-443d-bb6b-8963301de248 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.011810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae3700-4949-443d-bb6b-8963301de248 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.013296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 807/1618] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 31 11:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:34:17.019174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae3700-4949-443d-bb6b-8963301de248 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.084631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb8a6a-4fab-4c68-897a-7536a1d0391e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.096552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12ff7c-e5b9-4a33-b536-8bf98aadc445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.101946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12ff7c-e5b9-4a33-b536-8bf98aadc445 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.102389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12ff7c-e5b9-4a33-b536-8bf98aadc445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.102793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12ff7c-e5b9-4a33-b536-8bf98aadc445 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.103606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12ff7c-e5b9-4a33-b536-8bf98aadc445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.108151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12ff7c-e5b9-4a33-b536-8bf98aadc445 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.109885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae3700-4949-443d-bb6b-8963301de248 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.119073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83908d-46b3-419a-a702-9a72a5e42134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.119706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83908d-46b3-419a-a702-9a72a5e42134 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.121630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83908d-46b3-419a-a702-9a72a5e42134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.121917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83908d-46b3-419a-a702-9a72a5e42134 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.122573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83908d-46b3-419a-a702-9a72a5e42134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.129251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83908d-46b3-419a-a702-9a72a5e42134 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.156367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 812/1619] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:16 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:17.156367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054a4c5-0d72-4433-9336-f82e31085f1e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.156367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054a4c5-0d72-4433-9336-f82e31085f1e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.158576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054a4c5-0d72-4433-9336-f82e31085f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.190206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 808/1620] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:17 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:17.191965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83908d-46b3-419a-a702-9a72a5e42134 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.266702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6054a4c5-0d72-4433-9336-f82e31085f1e None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:17.268163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6054a4c5-0d72-4433-9336-f82e31085f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:17.314384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83908d-46b3-419a-a702-9a72a5e42134 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.320342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a293f80-06bb-41ec-8152-1539c1400041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.320971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293f80-06bb-41ec-8152-1539c1400041 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.321255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293f80-06bb-41ec-8152-1539c1400041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.321531 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293f80-06bb-41ec-8152-1539c1400041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.322189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a293f80-06bb-41ec-8152-1539c1400041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.324421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a293f80-06bb-41ec-8152-1539c1400041 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.339972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 809/1621] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:17.340984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a293f80-06bb-41ec-8152-1539c1400041 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.342902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:17.348594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:17.353296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a293f80-06bb-41ec-8152-1539c1400041 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.361192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe44a8-e1f3-47e4-9f5f-c4f484958dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.361776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe44a8-e1f3-47e4-9f5f-c4f484958dad admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.362066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe44a8-e1f3-47e4-9f5f-c4f484958dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.362444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe44a8-e1f3-47e4-9f5f-c4f484958dad admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.363706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe44a8-e1f3-47e4-9f5f-c4f484958dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.366645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe44a8-e1f3-47e4-9f5f-c4f484958dad admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.400949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 810/1622] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:17 2022] POST /identity/v3/users => generated 309 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:17.400949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe44a8-e1f3-47e4-9f5f-c4f484958dad admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.412281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe44a8-e1f3-47e4-9f5f-c4f484958dad admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.418612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dde8e-f817-4191-8eb3-fb594c571e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.419334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dde8e-f817-4191-8eb3-fb594c571e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.419619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dde8e-f817-4191-8eb3-fb594c571e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.419897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dde8e-f817-4191-8eb3-fb594c571e30 admin admin] PATH_INFO: `/v3/projects/0f6541f4958d4f48b60e4786fce85023/users/2e472d0eba3e4cb1958b18b96e8f2fc0/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.438889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 813/1623] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 31 11:34:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:17.447180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054a4c5-0d72-4433-9336-f82e31085f1e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.447986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dde8e-f817-4191-8eb3-fb594c571e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6541f4958d4f48b60e4786fce85023, user_id=2e472d0eba3e4cb1958b18b96e8f2fc0, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.451064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dde8e-f817-4191-8eb3-fb594c571e30 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.468796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054a4c5-0d72-4433-9336-f82e31085f1e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.472927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 811/1624] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:17 2022] PUT /identity/v3/projects/0f6541f4958d4f48b60e4786fce85023/users/2e472d0eba3e4cb1958b18b96e8f2fc0/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:17.474265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dde8e-f817-4191-8eb3-fb594c571e30 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.586756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dde8e-f817-4191-8eb3-fb594c571e30 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.596039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb773ec6-fdf3-4323-b4f6-c04c1f606e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.597261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb773ec6-fdf3-4323-b4f6-c04c1f606e55 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.597560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb773ec6-fdf3-4323-b4f6-c04c1f606e55 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.597889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb773ec6-fdf3-4323-b4f6-c04c1f606e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.629268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326becd-fed9-41f8-99cc-80ba6e22bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.630781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326becd-fed9-41f8-99cc-80ba6e22bf17 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.631428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326becd-fed9-41f8-99cc-80ba6e22bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.637826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326becd-fed9-41f8-99cc-80ba6e22bf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.640020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326becd-fed9-41f8-99cc-80ba6e22bf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.647230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326becd-fed9-41f8-99cc-80ba6e22bf17 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.690032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 814/1625] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:17.691277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb773ec6-fdf3-4323-b4f6-c04c1f606e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.694073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb773ec6-fdf3-4323-b4f6-c04c1f606e55 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.697801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326becd-fed9-41f8-99cc-80ba6e22bf17 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.720495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 812/1626] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:17.723507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb773ec6-fdf3-4323-b4f6-c04c1f606e55 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.738781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326becd-fed9-41f8-99cc-80ba6e22bf17 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.755035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c86b5-07ff-4cd8-aa11-0c8aa67bedff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.755677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c86b5-07ff-4cd8-aa11-0c8aa67bedff admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.755957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c86b5-07ff-4cd8-aa11-0c8aa67bedff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.756227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c86b5-07ff-4cd8-aa11-0c8aa67bedff admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.759946 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb773ec6-fdf3-4323-b4f6-c04c1f606e55 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.761246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c86b5-07ff-4cd8-aa11-0c8aa67bedff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.762918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c86b5-07ff-4cd8-aa11-0c8aa67bedff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.775952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe3d4-293e-4af1-b1f5-33ead885c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.781412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe3d4-293e-4af1-b1f5-33ead885c3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.783082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe3d4-293e-4af1-b1f5-33ead885c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.783082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe3d4-293e-4af1-b1f5-33ead885c3c0 admin admin] PATH_INFO: `/v3/projects/85f3f06ff0c94ee6835f16a941b3c998/users/910f5fc9521a4b2798afc00f53f015e5/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.802532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 815/1627] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:17.811777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c86b5-07ff-4cd8-aa11-0c8aa67bedff admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.841583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fe3d4-293e-4af1-b1f5-33ead885c3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f3f06ff0c94ee6835f16a941b3c998, user_id=910f5fc9521a4b2798afc00f53f015e5, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.844355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fe3d4-293e-4af1-b1f5-33ead885c3c0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.858504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c86b5-07ff-4cd8-aa11-0c8aa67bedff admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:17.874207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5f505-4984-40ab-b503-364e4c85ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:17.877193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f505-4984-40ab-b503-364e4c85ff87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.877487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f505-4984-40ab-b503-364e4c85ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.882000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 813/1628] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:17 2022] PUT /identity/v3/projects/85f3f06ff0c94ee6835f16a941b3c998/users/910f5fc9521a4b2798afc00f53f015e5/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:17.882186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f505-4984-40ab-b503-364e4c85ff87 admin admin] PATH_INFO: `/v3/projects/0f6541f4958d4f48b60e4786fce85023/users/2e472d0eba3e4cb1958b18b96e8f2fc0/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.882186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5f505-4984-40ab-b503-364e4c85ff87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6541f4958d4f48b60e4786fce85023, user_id=2e472d0eba3e4cb1958b18b96e8f2fc0, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:17.883169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe3d4-293e-4af1-b1f5-33ead885c3c0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:17.886269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5f505-4984-40ab-b503-364e4c85ff87 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:17.926445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 816/1629] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:17 2022] PUT /identity/v3/projects/0f6541f4958d4f48b60e4786fce85023/users/2e472d0eba3e4cb1958b18b96e8f2fc0/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:17.927978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adc7dd-b563-43e8-bea3-a495cf7d839c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:17.928857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adc7dd-b563-43e8-bea3-a495cf7d839c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:17.929202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adc7dd-b563-43e8-bea3-a495cf7d839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:17.975554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:17.995132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-50adc7dd-b563-43e8-bea3-a495cf7d839c None None] MFA Rules not processed for user `2e472d0eba3e4cb1958b18b96e8f2fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:17.996425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-50adc7dd-b563-43e8-bea3-a495cf7d839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:18.039244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe3d4-293e-4af1-b1f5-33ead885c3c0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:18.211930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 817/1630] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:18.221485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adc7dd-b563-43e8-bea3-a495cf7d839c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:18.279203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:18.289744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2225637-da02-4f87-8e55-cebfae9bbec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:18.292184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2225637-da02-4f87-8e55-cebfae9bbec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:18.293355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2225637-da02-4f87-8e55-cebfae9bbec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:18.293875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2225637-da02-4f87-8e55-cebfae9bbec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:18.297542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2225637-da02-4f87-8e55-cebfae9bbec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:18.302005 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2225637-da02-4f87-8e55-cebfae9bbec3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:18.334484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 814/1631] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:18.335116 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c08adf-19d0-457d-ab87-3507a7d5879c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:18.335725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c08adf-19d0-457d-ab87-3507a7d5879c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:18.337319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c08adf-19d0-457d-ab87-3507a7d5879c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:18.342326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 815/1632] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 31 11:34:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:34:18.343625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c08adf-19d0-457d-ab87-3507a7d5879c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:18.348803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adc7dd-b563-43e8-bea3-a495cf7d839c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:18.358782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174be85a-1d01-4997-be58-cc9c20156c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:18.359462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be85a-1d01-4997-be58-cc9c20156c04 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:18.360085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be85a-1d01-4997-be58-cc9c20156c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:18.360085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be85a-1d01-4997-be58-cc9c20156c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:18.374715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c08adf-19d0-457d-ab87-3507a7d5879c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:18.383892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174be85a-1d01-4997-be58-cc9c20156c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:18.388306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fc6e0-9b06-4c04-a960-b22e70e5a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:18.389566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fc6e0-9b06-4c04-a960-b22e70e5a209 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:18.392238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fc6e0-9b06-4c04-a960-b22e70e5a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:18.392725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fc6e0-9b06-4c04-a960-b22e70e5a209 admin admin] PATH_INFO: `/v3/projects/85f3f06ff0c94ee6835f16a941b3c998/users/910f5fc9521a4b2798afc00f53f015e5/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:18.399178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fc6e0-9b06-4c04-a960-b22e70e5a209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f3f06ff0c94ee6835f16a941b3c998, user_id=910f5fc9521a4b2798afc00f53f015e5, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:18.399670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174be85a-1d01-4997-be58-cc9c20156c04 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:18.402168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fc6e0-9b06-4c04-a960-b22e70e5a209 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:18.421118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 818/1633] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:18.422844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5188fb-a323-4e6e-adca-40777c93088f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:18.423317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5188fb-a323-4e6e-adca-40777c93088f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:18.424051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5188fb-a323-4e6e-adca-40777c93088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:18.449841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 816/1634] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:18 2022] PUT /identity/v3/projects/85f3f06ff0c94ee6835f16a941b3c998/users/910f5fc9521a4b2798afc00f53f015e5/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:18.460165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8e96-358e-412c-a80d-6004f7e63d87 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:18.460452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8e96-358e-412c-a80d-6004f7e63d87 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:18.460729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8e96-358e-412c-a80d-6004f7e63d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:18.475402 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9d5188fb-a323-4e6e-adca-40777c93088f None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:18.476690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9d5188fb-a323-4e6e-adca-40777c93088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:18.533334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e16f8e96-358e-412c-a80d-6004f7e63d87 None None] MFA Rules not processed for user `910f5fc9521a4b2798afc00f53f015e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:18.534719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e16f8e96-358e-412c-a80d-6004f7e63d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:18.576458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 819/1635] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:34:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:18.598260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5188fb-a323-4e6e-adca-40777c93088f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:18.735632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 817/1636] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:18.744145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5188fb-a323-4e6e-adca-40777c93088f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:18.755456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793dddb-7aef-43bb-88a3-9823f6714499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:18.756242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793dddb-7aef-43bb-88a3-9823f6714499 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:18.756520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793dddb-7aef-43bb-88a3-9823f6714499 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:18.756796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793dddb-7aef-43bb-88a3-9823f6714499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:18.773775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8e96-358e-412c-a80d-6004f7e63d87 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:18.781426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793dddb-7aef-43bb-88a3-9823f6714499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:18.782989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793dddb-7aef-43bb-88a3-9823f6714499 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:18.786262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8e96-358e-412c-a80d-6004f7e63d87 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:18.791890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53504b-50a5-4f94-94c0-f61290b05c95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:18.792898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53504b-50a5-4f94-94c0-f61290b05c95 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:18.793365 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53504b-50a5-4f94-94c0-f61290b05c95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:18.793938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53504b-50a5-4f94-94c0-f61290b05c95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:18.798255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 820/1637] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:18.825203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53504b-50a5-4f94-94c0-f61290b05c95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:18.829225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53504b-50a5-4f94-94c0-f61290b05c95 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:18.887398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 818/1638] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:19.310937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793dddb-7aef-43bb-88a3-9823f6714499 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:19.544420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793dddb-7aef-43bb-88a3-9823f6714499 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:19.580717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:19.582652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:19.584890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:19.584890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] PATH_INFO: `/v3/users/6e7cab3cddc64595a58bc642af5c47ff` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:19.586638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7cab3cddc64595a58bc642af5c47ff)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:19.592577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:19.600463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:19.733301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7cab3cddc64595a58bc642af5c47ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:19.748628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53504b-50a5-4f94-94c0-f61290b05c95 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:19.762727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7cab3cddc64595a58bc642af5c47ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:19.763827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53504b-50a5-4f94-94c0-f61290b05c95 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:19.771625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7cab3cddc64595a58bc642af5c47ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:19.774216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:19.774891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:19.779505 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:19.779892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] PATH_INFO: `/v3/users/d1a62b20b68c472badbfe82a2063fcb8` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:19.782312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a62b20b68c472badbfe82a2063fcb8)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:19.782882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7cab3cddc64595a58bc642af5c47ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:19.785965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:34:19.785965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: warnings.warn(msg) Aug 31 11:34:19.785965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: Aug 31 11:34:19.786875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-749e5007-7bc3-4ae4-9205-0629ce4dabb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7cab3cddc64595a58bc642af5c47ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:19.787313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:19.803806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 821/1639] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:19 2022] DELETE /identity/v3/users/6e7cab3cddc64595a58bc642af5c47ff => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:19.805699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583c8d-1da7-4c12-98f5-ae896aaa12e0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:19.806051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583c8d-1da7-4c12-98f5-ae896aaa12e0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:19.806372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583c8d-1da7-4c12-98f5-ae896aaa12e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:19.835479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0e583c8d-1da7-4c12-98f5-ae896aaa12e0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:19.836992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0e583c8d-1da7-4c12-98f5-ae896aaa12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:19.938110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:19.947506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 822/1640] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:19.973801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a62b20b68c472badbfe82a2063fcb8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:19.988832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a62b20b68c472badbfe82a2063fcb8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:19.990030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a62b20b68c472badbfe82a2063fcb8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:20.015131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a62b20b68c472badbfe82a2063fcb8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:20.028336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a62b20b68c472badbfe82a2063fcb8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:20.045307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 819/1641] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:19 2022] DELETE /identity/v3/users/d1a62b20b68c472badbfe82a2063fcb8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:20.051346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe903a-898c-4a10-a1d6-5857c39bf568 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:20.051773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe903a-898c-4a10-a1d6-5857c39bf568 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:20.052207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe903a-898c-4a10-a1d6-5857c39bf568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:20.075193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9bbe903a-898c-4a10-a1d6-5857c39bf568 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:20.077658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9bbe903a-898c-4a10-a1d6-5857c39bf568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:20.121681 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:20.123736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:20.170348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 823/1642] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:20.180606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a658a-33de-4220-a020-e930c8a4a832 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:20.181045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a658a-33de-4220-a020-e930c8a4a832 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:20.181457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a658a-33de-4220-a020-e930c8a4a832 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:20.183504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 824/1643] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 31 11:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:34:20.198207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c249f-7f92-42b7-9a78-b8af5925d6b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:20.198539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c249f-7f92-42b7-9a78-b8af5925d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:20.198975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c249f-7f92-42b7-9a78-b8af5925d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:20.252578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-135c249f-7f92-42b7-9a78-b8af5925d6b2 None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:20.259806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-135c249f-7f92-42b7-9a78-b8af5925d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:20.267137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a5e42-95a7-4ce3-bea1-63f79b2efc86 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:20.275183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754750e6-14b3-4f13-87d6-6b80012de5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:20.276075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754750e6-14b3-4f13-87d6-6b80012de5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:20.286834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754750e6-14b3-4f13-87d6-6b80012de5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:20.287160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754750e6-14b3-4f13-87d6-6b80012de5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:20.288447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:20.289514 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-754750e6-14b3-4f13-87d6-6b80012de5c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:20.318239 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754750e6-14b3-4f13-87d6-6b80012de5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:20.320730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754750e6-14b3-4f13-87d6-6b80012de5c5 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:20.349362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 820/1644] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:20.441319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 825/1645] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 31 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:20.442668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a650e0-4269-4041-820b-d5d2faedbb91 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:20.442668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a650e0-4269-4041-820b-d5d2faedbb91 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:20.442880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a650e0-4269-4041-820b-d5d2faedbb91 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:20.444223 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 821/1646] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 31 11:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:34:20.451415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd79b43-b8b5-4449-ae0a-5ca684dc70f5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:20.451415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd79b43-b8b5-4449-ae0a-5ca684dc70f5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:20.451415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd79b43-b8b5-4449-ae0a-5ca684dc70f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:20.501541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ddd79b43-b8b5-4449-ae0a-5ca684dc70f5 None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:20.507499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ddd79b43-b8b5-4449-ae0a-5ca684dc70f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:20.507720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a650e0-4269-4041-820b-d5d2faedbb91 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:20.534597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a650e0-4269-4041-820b-d5d2faedbb91 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:20.544465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703befd4-a450-44ce-be73-5c2fc030db65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:20.545085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703befd4-a450-44ce-be73-5c2fc030db65 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:20.545359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703befd4-a450-44ce-be73-5c2fc030db65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:20.545629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703befd4-a450-44ce-be73-5c2fc030db65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:20.559729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 826/1647] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:20.593313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703befd4-a450-44ce-be73-5c2fc030db65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:20.593313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703befd4-a450-44ce-be73-5c2fc030db65 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:20.599982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd79b43-b8b5-4449-ae0a-5ca684dc70f5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:20.599982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ddd79b43-b8b5-4449-ae0a-5ca684dc70f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:20.616888 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 822/1648] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:20.840280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd79b43-b8b5-4449-ae0a-5ca684dc70f5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:20.849262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dfcd5-8aba-498f-be1e-1f69d389b0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:20.849903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dfcd5-8aba-498f-be1e-1f69d389b0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:20.850182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dfcd5-8aba-498f-be1e-1f69d389b0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:20.856103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dfcd5-8aba-498f-be1e-1f69d389b0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:20.896274 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dfcd5-8aba-498f-be1e-1f69d389b0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:20.902804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dfcd5-8aba-498f-be1e-1f69d389b0d0 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:20.966541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 827/1649] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:22.182813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703befd4-a450-44ce-be73-5c2fc030db65 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:22.184246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-703befd4-a450-44ce-be73-5c2fc030db65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:22.214378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703befd4-a450-44ce-be73-5c2fc030db65 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:22.231123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:22.231951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:22.232391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:22.233064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] PATH_INFO: `/v3/projects/16cb889cd2f84b679d5d559746f51330` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:22.234566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cb889cd2f84b679d5d559746f51330)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:22.236651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:22.347219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cb889cd2f84b679d5d559746f51330', 'request_id': 'req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.364465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cb889cd2f84b679d5d559746f51330', 'request_id': 'req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.381561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cb889cd2f84b679d5d559746f51330', 'request_id': 'req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.404479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] The token cache is being invalidate because project 16cb889cd2f84b679d5d559746f51330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:22.405319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.407040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.411925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 823/1650] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:22 2022] DELETE /identity/v3/projects/16cb889cd2f84b679d5d559746f51330 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:22.416648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dfcd5-8aba-498f-be1e-1f69d389b0d0 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:22.418463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:22.420080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:22.441916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dfcd5-8aba-498f-be1e-1f69d389b0d0 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:22.475020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:22.579950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c444a3d-a2b7-4f3d-8be4-0f4eeb1c71d9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:22.599507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:22.600390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:22.600842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:22.601307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] PATH_INFO: `/v3/projects/006e454e548446b7b62a83d4045af3c2` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:22.603148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=006e454e548446b7b62a83d4045af3c2)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:22.605301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:22.639421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:22.640804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:22.641293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:22.641741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] PATH_INFO: `/v3/users/910f5fc9521a4b2798afc00f53f015e5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:22.643636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] RBAC: Authorizing `identity:delete_user(user_id=910f5fc9521a4b2798afc00f53f015e5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:22.646166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:22.712710 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006e454e548446b7b62a83d4045af3c2', 'request_id': 'req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.734814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006e454e548446b7b62a83d4045af3c2', 'request_id': 'req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.767340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006e454e548446b7b62a83d4045af3c2', 'request_id': 'req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.769983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910f5fc9521a4b2798afc00f53f015e5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.777534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:22.823275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] The token cache is being invalidate because project 006e454e548446b7b62a83d4045af3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:22.823882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.825451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.827629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 824/1651] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:22 2022] DELETE /identity/v3/projects/006e454e548446b7b62a83d4045af3c2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:34:22.832916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910f5fc9521a4b2798afc00f53f015e5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.835855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:22.838380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:22.850006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910f5fc9521a4b2798afc00f53f015e5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.861089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910f5fc9521a4b2798afc00f53f015e5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.861929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910f5fc9521a4b2798afc00f53f015e5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:22.874409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 828/1652] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:22 2022] DELETE /identity/v3/users/910f5fc9521a4b2798afc00f53f015e5 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:22.984842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bddbb-7974-49f4-a4f2-909ea154c6bf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:23.136955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:23.139250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:23.141629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:23.142087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] PATH_INFO: `/v3/users/2e472d0eba3e4cb1958b18b96e8f2fc0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:23.145650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e472d0eba3e4cb1958b18b96e8f2fc0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:23.148845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:23.154087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:23.227312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e472d0eba3e4cb1958b18b96e8f2fc0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.238754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e472d0eba3e4cb1958b18b96e8f2fc0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.240131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e472d0eba3e4cb1958b18b96e8f2fc0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.277451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e472d0eba3e4cb1958b18b96e8f2fc0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.324349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc4bde3d-4de6-4c93-aaa0-a756af0dcbc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e472d0eba3e4cb1958b18b96e8f2fc0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.332513 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:23.333885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:23.360936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 825/1653] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:22 2022] DELETE /identity/v3/users/2e472d0eba3e4cb1958b18b96e8f2fc0 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:23.370258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fa6bf-e472-44e5-88dd-74df4783004e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:23.580389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:23.582120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:23.582416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:23.582740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] PATH_INFO: `/v3/projects/85f3f06ff0c94ee6835f16a941b3c998` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:23.587991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f3f06ff0c94ee6835f16a941b3c998)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:23.589051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:34:23.589051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 31 11:34:23.589051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: Aug 31 11:34:23.595472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:23.767222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f3f06ff0c94ee6835f16a941b3c998', 'request_id': 'req-cf1f678f-3cb2-4387-95db-6212563b6c79'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.782504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f3f06ff0c94ee6835f16a941b3c998', 'request_id': 'req-cf1f678f-3cb2-4387-95db-6212563b6c79'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.792552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f3f06ff0c94ee6835f16a941b3c998', 'request_id': 'req-cf1f678f-3cb2-4387-95db-6212563b6c79'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.852291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] The token cache is being invalidate because project 85f3f06ff0c94ee6835f16a941b3c998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:23.852646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.853337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cf1f678f-3cb2-4387-95db-6212563b6c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:23.863609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0476-5710-4b50-8567-6e7c5a56a517 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:23.864558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0476-5710-4b50-8567-6e7c5a56a517 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:23.864851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0476-5710-4b50-8567-6e7c5a56a517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:23.876418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 829/1654] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:23 2022] DELETE /identity/v3/projects/85f3f06ff0c94ee6835f16a941b3c998 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:23.915015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-082e0476-5710-4b50-8567-6e7c5a56a517 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:23.916297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-082e0476-5710-4b50-8567-6e7c5a56a517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:24.057700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71d7e-a9f1-4489-a92b-0848290fea3e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.057989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71d7e-a9f1-4489-a92b-0848290fea3e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.058475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71d7e-a9f1-4489-a92b-0848290fea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.062656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 826/1655] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:24.092229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dcd71d7e-a9f1-4489-a92b-0848290fea3e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:24.093602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dcd71d7e-a9f1-4489-a92b-0848290fea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:24.111158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e0476-5710-4b50-8567-6e7c5a56a517 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:24.124551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 830/1656] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:24.125578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd71d7e-a9f1-4489-a92b-0848290fea3e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:24.127659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e0476-5710-4b50-8567-6e7c5a56a517 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:24.131064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dcd71d7e-a9f1-4489-a92b-0848290fea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:24.143114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278ab38-02cf-4091-a8b0-1595334a2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:24.144954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278ab38-02cf-4091-a8b0-1595334a2220 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.145452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278ab38-02cf-4091-a8b0-1595334a2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.145730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278ab38-02cf-4091-a8b0-1595334a2220 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.148550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278ab38-02cf-4091-a8b0-1595334a2220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:24.148930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278ab38-02cf-4091-a8b0-1595334a2220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:24.153394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278ab38-02cf-4091-a8b0-1595334a2220 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:24.163270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd71d7e-a9f1-4489-a92b-0848290fea3e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:24.186233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:24.187012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.187303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.187583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] PATH_INFO: `/v3/projects/0f6541f4958d4f48b60e4786fce85023` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.188613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 827/1657] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:24.189524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278ab38-02cf-4091-a8b0-1595334a2220 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:24.191992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6541f4958d4f48b60e4786fce85023)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:24.196754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:24.215263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278ab38-02cf-4091-a8b0-1595334a2220 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:24.234709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a2d0d-b053-4bc0-addc-28c7cf74e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:24.234709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a2d0d-b053-4bc0-addc-28c7cf74e811 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.234709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a2d0d-b053-4bc0-addc-28c7cf74e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.234709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a2d0d-b053-4bc0-addc-28c7cf74e811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.235624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a2d0d-b053-4bc0-addc-28c7cf74e811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:24.235624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a2d0d-b053-4bc0-addc-28c7cf74e811 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:24.344355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:24.344541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 828/1658] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:24 2022] POST /identity/v3/projects => generated 403 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:24.351859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a2d0d-b053-4bc0-addc-28c7cf74e811 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:24.371893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6541f4958d4f48b60e4786fce85023', 'request_id': 'req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:24.394868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6541f4958d4f48b60e4786fce85023', 'request_id': 'req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:24.429927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6541f4958d4f48b60e4786fce85023', 'request_id': 'req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:24.470143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] The token cache is being invalidate because project 0f6541f4958d4f48b60e4786fce85023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:24.470448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:24.472346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ba15c09-5595-4470-bdd3-3c7cdfa898c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:24.475350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 831/1659] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:24 2022] DELETE /identity/v3/projects/0f6541f4958d4f48b60e4786fce85023 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:24.479964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab4c3-0937-4381-8064-45274a7a3505 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.480395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab4c3-0937-4381-8064-45274a7a3505 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.480812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab4c3-0937-4381-8064-45274a7a3505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.517246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:24.558775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b9aab4c3-0937-4381-8064-45274a7a3505 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:24.574822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9aab4c3-0937-4381-8064-45274a7a3505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:24.605173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a2d0d-b053-4bc0-addc-28c7cf74e811 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:24.630988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 832/1660] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:24.634401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7f495-5b95-4978-bcd1-4f03dbde3d3e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.639024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7f495-5b95-4978-bcd1-4f03dbde3d3e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.639024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7f495-5b95-4978-bcd1-4f03dbde3d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.643784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5232bee-3246-490b-8e0e-50087d77894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:24.644380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232bee-3246-490b-8e0e-50087d77894f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.644676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232bee-3246-490b-8e0e-50087d77894f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.645083 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232bee-3246-490b-8e0e-50087d77894f admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.645811 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5232bee-3246-490b-8e0e-50087d77894f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:24.657085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5232bee-3246-490b-8e0e-50087d77894f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:24.741165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dff7f495-5b95-4978-bcd1-4f03dbde3d3e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:24.743649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dff7f495-5b95-4978-bcd1-4f03dbde3d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:24.770430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 829/1661] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:24 2022] POST /identity/v3/users => generated 302 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:24.771457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5232bee-3246-490b-8e0e-50087d77894f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:24.775840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f5232bee-3246-490b-8e0e-50087d77894f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:24.785125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 833/1662] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:24.793200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7f495-5b95-4978-bcd1-4f03dbde3d3e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:24.815654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7f495-5b95-4978-bcd1-4f03dbde3d3e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:24.830875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027f66c-7965-4502-a2f9-85fd02da0db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:24.831818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f66c-7965-4502-a2f9-85fd02da0db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.832109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f66c-7965-4502-a2f9-85fd02da0db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.832390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f66c-7965-4502-a2f9-85fd02da0db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.833077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027f66c-7965-4502-a2f9-85fd02da0db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:24.833387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027f66c-7965-4502-a2f9-85fd02da0db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:24.835100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027f66c-7965-4502-a2f9-85fd02da0db6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:24.841119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5232bee-3246-490b-8e0e-50087d77894f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:24.872764 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 834/1663] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:24.876475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027f66c-7965-4502-a2f9-85fd02da0db6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:24.880645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbecd4-9a36-4cd2-8020-fb878908f105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:24.881478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbecd4-9a36-4cd2-8020-fb878908f105 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.881764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbecd4-9a36-4cd2-8020-fb878908f105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.882038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbecd4-9a36-4cd2-8020-fb878908f105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.882854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbecd4-9a36-4cd2-8020-fb878908f105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:24.896340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbecd4-9a36-4cd2-8020-fb878908f105 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:24.904351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027f66c-7965-4502-a2f9-85fd02da0db6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:24.929790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc45db-dcfa-45e9-bdfd-2a59e9e91322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:24.930911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc45db-dcfa-45e9-bdfd-2a59e9e91322 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:24.931335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc45db-dcfa-45e9-bdfd-2a59e9e91322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:24.931754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc45db-dcfa-45e9-bdfd-2a59e9e91322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:24.932620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc45db-dcfa-45e9-bdfd-2a59e9e91322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:24.934959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc45db-dcfa-45e9-bdfd-2a59e9e91322 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:24.952688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 830/1664] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:24.959929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbecd4-9a36-4cd2-8020-fb878908f105 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:25.006372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbecd4-9a36-4cd2-8020-fb878908f105 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:25.024681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 835/1665] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:24 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:25.026293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc45db-dcfa-45e9-bdfd-2a59e9e91322 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:25.027229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94110e2b-fed6-4415-9992-55f52c6af4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:25.028835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94110e2b-fed6-4415-9992-55f52c6af4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:25.029364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94110e2b-fed6-4415-9992-55f52c6af4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:25.030263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94110e2b-fed6-4415-9992-55f52c6af4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:25.031741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94110e2b-fed6-4415-9992-55f52c6af4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:25.033564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94110e2b-fed6-4415-9992-55f52c6af4a2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:25.056197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 831/1666] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:25.058170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94110e2b-fed6-4415-9992-55f52c6af4a2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:25.085202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94110e2b-fed6-4415-9992-55f52c6af4a2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:25.199833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc45db-dcfa-45e9-bdfd-2a59e9e91322 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:25.215208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50f472-0745-42bd-8b12-13113ea871ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:25.215885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50f472-0745-42bd-8b12-13113ea871ac admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:25.216163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50f472-0745-42bd-8b12-13113ea871ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:25.216433 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50f472-0745-42bd-8b12-13113ea871ac admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:25.217084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50f472-0745-42bd-8b12-13113ea871ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:25.220047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50f472-0745-42bd-8b12-13113ea871ac admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:25.252695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092aefe-4c23-4aac-bd7a-104cf482e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:25.254458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092aefe-4c23-4aac-bd7a-104cf482e82e admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:25.254875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092aefe-4c23-4aac-bd7a-104cf482e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:25.255255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092aefe-4c23-4aac-bd7a-104cf482e82e admin admin] PATH_INFO: `/v3/projects/e187e3b7894b4cb09a3807bdbea145fc/users/ae5eae3f61ad4449b008c085ca01519e/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:25.283756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 836/1667] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:25 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:25.286117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50f472-0745-42bd-8b12-13113ea871ac admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:25.295309 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092aefe-4c23-4aac-bd7a-104cf482e82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e187e3b7894b4cb09a3807bdbea145fc, user_id=ae5eae3f61ad4449b008c085ca01519e, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:25.305260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092aefe-4c23-4aac-bd7a-104cf482e82e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:25.305861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50f472-0745-42bd-8b12-13113ea871ac admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:25.321306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377143a-d2da-444c-8112-3a40b3b5d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:25.322081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377143a-d2da-444c-8112-3a40b3b5d462 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:25.323012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377143a-d2da-444c-8112-3a40b3b5d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:25.323870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377143a-d2da-444c-8112-3a40b3b5d462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:25.325412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377143a-d2da-444c-8112-3a40b3b5d462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:25.329033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377143a-d2da-444c-8112-3a40b3b5d462 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:25.340744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 832/1668] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:25 2022] PUT /identity/v3/projects/e187e3b7894b4cb09a3807bdbea145fc/users/ae5eae3f61ad4449b008c085ca01519e/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:25.342577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c683cce-bcb3-49be-9d54-94651c9083d6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:25.342939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c683cce-bcb3-49be-9d54-94651c9083d6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:25.343389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c683cce-bcb3-49be-9d54-94651c9083d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:25.359745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 837/1669] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:25.360841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377143a-d2da-444c-8112-3a40b3b5d462 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:25.396057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3c683cce-bcb3-49be-9d54-94651c9083d6 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:25.397516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3c683cce-bcb3-49be-9d54-94651c9083d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:25.399339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377143a-d2da-444c-8112-3a40b3b5d462 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:25.517225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 833/1670] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:25.527281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c683cce-bcb3-49be-9d54-94651c9083d6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:25.528880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3c683cce-bcb3-49be-9d54-94651c9083d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:25.579233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6344546-e07c-4db7-bae6-b6526c4d43cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:25.583035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6344546-e07c-4db7-bae6-b6526c4d43cd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:25.592049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6344546-e07c-4db7-bae6-b6526c4d43cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:25.592049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6344546-e07c-4db7-bae6-b6526c4d43cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:25.594075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6344546-e07c-4db7-bae6-b6526c4d43cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:25.597949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6344546-e07c-4db7-bae6-b6526c4d43cd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:25.625958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:25.641152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 838/1671] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:25.647702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6344546-e07c-4db7-bae6-b6526c4d43cd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:25.677729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:25.680166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6344546-e07c-4db7-bae6-b6526c4d43cd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:25.695282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb38be-d115-440e-8271-45f76171cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:25.695282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb38be-d115-440e-8271-45f76171cf9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:25.695282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb38be-d115-440e-8271-45f76171cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:25.695282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb38be-d115-440e-8271-45f76171cf9e admin admin] PATH_INFO: `/v3/projects/ea17060e9a6f46079b75ccf263e4e500/users/cb56c43f806a45cca5e4cf0502234968/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:25.730179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c683cce-bcb3-49be-9d54-94651c9083d6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:25.742571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a5791-43e7-4833-b9d8-15925dae7c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:25.743635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb38be-d115-440e-8271-45f76171cf9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea17060e9a6f46079b75ccf263e4e500, user_id=cb56c43f806a45cca5e4cf0502234968, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:25.745349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a5791-43e7-4833-b9d8-15925dae7c8f service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:25.745633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a5791-43e7-4833-b9d8-15925dae7c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:25.745906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a5791-43e7-4833-b9d8-15925dae7c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:25.751452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb38be-d115-440e-8271-45f76171cf9e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:25.796493 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a5791-43e7-4833-b9d8-15925dae7c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:25.808045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 839/1672] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:25 2022] PUT /identity/v3/projects/ea17060e9a6f46079b75ccf263e4e500/users/cb56c43f806a45cca5e4cf0502234968/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:25.817004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a5791-43e7-4833-b9d8-15925dae7c8f service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:25.819440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73220-2575-4a5c-aa94-14f2ba0c0f04 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:25.819959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73220-2575-4a5c-aa94-14f2ba0c0f04 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:25.820442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73220-2575-4a5c-aa94-14f2ba0c0f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:25.842523 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 834/1673] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:25.976455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-00a73220-2575-4a5c-aa94-14f2ba0c0f04 None None] MFA Rules not processed for user `cb56c43f806a45cca5e4cf0502234968`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:25.977700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00a73220-2575-4a5c-aa94-14f2ba0c0f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:26.181599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a5791-43e7-4833-b9d8-15925dae7c8f service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:26.188410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a67a5791-43e7-4833-b9d8-15925dae7c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:26.227071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a5791-43e7-4833-b9d8-15925dae7c8f service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:26.254796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 840/1674] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 31 11:34:26.263539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a73220-2575-4a5c-aa94-14f2ba0c0f04 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:26.397343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:26.398589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:26.407300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:26.407801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] PATH_INFO: `/v3/users/cfacb5f74eb8454bb9ae8adb349b7383` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:26.413267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfacb5f74eb8454bb9ae8adb349b7383)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:26.416407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:26.486462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a73220-2575-4a5c-aa94-14f2ba0c0f04 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:26.499599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147424e-fd6d-4fde-9082-5fd510ac60f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:26.500246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147424e-fd6d-4fde-9082-5fd510ac60f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:26.504418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147424e-fd6d-4fde-9082-5fd510ac60f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:26.504963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147424e-fd6d-4fde-9082-5fd510ac60f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:26.505777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147424e-fd6d-4fde-9082-5fd510ac60f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:26.509088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfacb5f74eb8454bb9ae8adb349b7383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:26.510118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147424e-fd6d-4fde-9082-5fd510ac60f3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:26.520987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfacb5f74eb8454bb9ae8adb349b7383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:26.522020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfacb5f74eb8454bb9ae8adb349b7383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:26.540587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfacb5f74eb8454bb9ae8adb349b7383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:26.549234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-937b46ee-ac68-4065-94f1-08e91adc68f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfacb5f74eb8454bb9ae8adb349b7383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:26.559783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 835/1675] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:26 2022] DELETE /identity/v3/users/cfacb5f74eb8454bb9ae8adb349b7383 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:26.561548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7114b9-12e3-46e5-8bc2-331482664786 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:26.562048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7114b9-12e3-46e5-8bc2-331482664786 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:26.562494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7114b9-12e3-46e5-8bc2-331482664786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:26.579133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 841/1676] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:26 2022] POST /identity/v3/projects => generated 369 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:26.583634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147424e-fd6d-4fde-9082-5fd510ac60f3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:26.587081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7147424e-fd6d-4fde-9082-5fd510ac60f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:26.587654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3e7114b9-12e3-46e5-8bc2-331482664786 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:26.589008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3e7114b9-12e3-46e5-8bc2-331482664786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:26.654881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:26.678579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 836/1677] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:26.728529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:26.760608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147424e-fd6d-4fde-9082-5fd510ac60f3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:26.775669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aaf50-a94d-4ef5-b908-850589e9d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:26.776588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aaf50-a94d-4ef5-b908-850589e9d26c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:26.777123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aaf50-a94d-4ef5-b908-850589e9d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:26.777538 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aaf50-a94d-4ef5-b908-850589e9d26c admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:26.778374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940aaf50-a94d-4ef5-b908-850589e9d26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:26.780773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940aaf50-a94d-4ef5-b908-850589e9d26c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:26.820392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 842/1678] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:26 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:34:26.824002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7114b9-12e3-46e5-8bc2-331482664786 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:26.840163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7114b9-12e3-46e5-8bc2-331482664786 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:26.852283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16881df2-e1a9-4716-b57a-69b6af8a9b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:26.852922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16881df2-e1a9-4716-b57a-69b6af8a9b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:26.853201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16881df2-e1a9-4716-b57a-69b6af8a9b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:26.853478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16881df2-e1a9-4716-b57a-69b6af8a9b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:26.854131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16881df2-e1a9-4716-b57a-69b6af8a9b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:26.861862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16881df2-e1a9-4716-b57a-69b6af8a9b60 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:26.863264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aaf50-a94d-4ef5-b908-850589e9d26c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:26.865755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-940aaf50-a94d-4ef5-b908-850589e9d26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:26.890195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 837/1679] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:26.891897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16881df2-e1a9-4716-b57a-69b6af8a9b60 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:26.914844 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16881df2-e1a9-4716-b57a-69b6af8a9b60 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:26.929294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633eee22-222e-45ca-a6aa-41e10b1e3c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:26.930397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eee22-222e-45ca-a6aa-41e10b1e3c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:26.930936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eee22-222e-45ca-a6aa-41e10b1e3c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:26.931419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eee22-222e-45ca-a6aa-41e10b1e3c71 admin admin] PATH_INFO: `/v3/projects/a6ba533cef3d49d38e356c2dcd771145/users/fb9da276833c459695c9d1e12f2c0def/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:26.980065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633eee22-222e-45ca-a6aa-41e10b1e3c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ba533cef3d49d38e356c2dcd771145, user_id=fb9da276833c459695c9d1e12f2c0def, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:26.984934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633eee22-222e-45ca-a6aa-41e10b1e3c71 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:27.017666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 838/1680] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:26 2022] PUT /identity/v3/projects/a6ba533cef3d49d38e356c2dcd771145/users/fb9da276833c459695c9d1e12f2c0def/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:27.021441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633eee22-222e-45ca-a6aa-41e10b1e3c71 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:27.033883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aaf50-a94d-4ef5-b908-850589e9d26c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:27.203875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b064a-9e61-4e56-afb8-85a449a78cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:27.206647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b064a-9e61-4e56-afb8-85a449a78cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:27.207058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b064a-9e61-4e56-afb8-85a449a78cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:27.208084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b064a-9e61-4e56-afb8-85a449a78cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:27.264575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633eee22-222e-45ca-a6aa-41e10b1e3c71 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:27.285575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba4a33-01cd-4590-a097-95470f32fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:27.286436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4a33-01cd-4590-a097-95470f32fbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:27.286863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4a33-01cd-4590-a097-95470f32fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:27.287508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4a33-01cd-4590-a097-95470f32fbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:27.288583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba4a33-01cd-4590-a097-95470f32fbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:27.291603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba4a33-01cd-4590-a097-95470f32fbb7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:27.327533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 839/1681] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:27.335786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba4a33-01cd-4590-a097-95470f32fbb7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:27.352911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba4a33-01cd-4590-a097-95470f32fbb7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:27.372745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf48a0-9288-4095-b5d8-a16657e6d71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:27.373564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf48a0-9288-4095-b5d8-a16657e6d71a admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:27.374405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf48a0-9288-4095-b5d8-a16657e6d71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:27.374405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf48a0-9288-4095-b5d8-a16657e6d71a admin admin] PATH_INFO: `/v3/projects/a6ba533cef3d49d38e356c2dcd771145/users/fb9da276833c459695c9d1e12f2c0def/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:27.376553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf48a0-9288-4095-b5d8-a16657e6d71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ba533cef3d49d38e356c2dcd771145, user_id=fb9da276833c459695c9d1e12f2c0def, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:27.376818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b064a-9e61-4e56-afb8-85a449a78cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:27.379204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b064a-9e61-4e56-afb8-85a449a78cb0 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:27.380337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf48a0-9288-4095-b5d8-a16657e6d71a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:27.394791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 843/1682] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:27.414137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 840/1683] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:27 2022] PUT /identity/v3/projects/a6ba533cef3d49d38e356c2dcd771145/users/fb9da276833c459695c9d1e12f2c0def/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:27.423121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfebabe-cf36-4d47-bb48-dbf486938a3e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:27.424212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfebabe-cf36-4d47-bb48-dbf486938a3e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:27.424212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfebabe-cf36-4d47-bb48-dbf486938a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:27.511403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8cfebabe-cf36-4d47-bb48-dbf486938a3e None None] MFA Rules not processed for user `fb9da276833c459695c9d1e12f2c0def`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:27.515558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8cfebabe-cf36-4d47-bb48-dbf486938a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:27.586420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:27.642989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 844/1684] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:27.655107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf48a0-9288-4095-b5d8-a16657e6d71a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:27.657418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2fdf48a0-9288-4095-b5d8-a16657e6d71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:27.783944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf48a0-9288-4095-b5d8-a16657e6d71a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:27.806628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea9f80-82cd-4323-a611-38dcf797024b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:27.814885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea9f80-82cd-4323-a611-38dcf797024b service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:27.815744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea9f80-82cd-4323-a611-38dcf797024b service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:27.815980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea9f80-82cd-4323-a611-38dcf797024b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:27.843510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea9f80-82cd-4323-a611-38dcf797024b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:27.844967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea9f80-82cd-4323-a611-38dcf797024b service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:27.863048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 841/1685] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:28.741561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfebabe-cf36-4d47-bb48-dbf486938a3e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:28.744492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8cfebabe-cf36-4d47-bb48-dbf486938a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:28.964517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfebabe-cf36-4d47-bb48-dbf486938a3e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:28.969306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:28.969955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:28.970231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:28.970501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] PATH_INFO: `/v3/projects/46086fc0b16346d086be7469d20f6c8f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:28.971888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] RBAC: Authorizing `identity:delete_project(project_id=46086fc0b16346d086be7469d20f6c8f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:28.973823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:29.137665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46086fc0b16346d086be7469d20f6c8f', 'request_id': 'req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.163344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46086fc0b16346d086be7469d20f6c8f', 'request_id': 'req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.174988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46086fc0b16346d086be7469d20f6c8f', 'request_id': 'req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.209181 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] The token cache is being invalidate because project 46086fc0b16346d086be7469d20f6c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:29.209517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.210207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d8b2ffa-a3b5-4d02-b8e6-dec5b691662b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.217352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 845/1686] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:28 2022] DELETE /identity/v3/projects/46086fc0b16346d086be7469d20f6c8f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:29.218825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832ef72-924f-4a47-8d81-c8e060558f03 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:29.219274 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832ef72-924f-4a47-8d81-c8e060558f03 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:29.219426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832ef72-924f-4a47-8d81-c8e060558f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:29.269551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3832ef72-924f-4a47-8d81-c8e060558f03 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:29.273270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3832ef72-924f-4a47-8d81-c8e060558f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:29.397715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:29.449184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 842/1687] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:29.456972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aef07-decc-49aa-9413-9ce2a4520f80 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:29.457394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aef07-decc-49aa-9413-9ce2a4520f80 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:29.457675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aef07-decc-49aa-9413-9ce2a4520f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:29.527753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a88aef07-decc-49aa-9413-9ce2a4520f80 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:29.529010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a88aef07-decc-49aa-9413-9ce2a4520f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:29.566739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 846/1688] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:29.570633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832ef72-924f-4a47-8d81-c8e060558f03 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:29.586343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832ef72-924f-4a47-8d81-c8e060558f03 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:29.602442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:29.604243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:29.608352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:29.610333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:29.613943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:29.614270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:29.620852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:29.664397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 843/1689] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:29.669921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88aef07-decc-49aa-9413-9ce2a4520f80 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:29.701351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88aef07-decc-49aa-9413-9ce2a4520f80 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:29.713232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:29.715768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:29.722049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdf2d9-88c6-4c9c-89d1-061cc0cb78ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:29.723440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdf2d9-88c6-4c9c-89d1-061cc0cb78ba admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:29.723883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdf2d9-88c6-4c9c-89d1-061cc0cb78ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:29.724668 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdf2d9-88c6-4c9c-89d1-061cc0cb78ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:29.725457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdf2d9-88c6-4c9c-89d1-061cc0cb78ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:29.733159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdf2d9-88c6-4c9c-89d1-061cc0cb78ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:29.760468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6eb66-107a-417e-892e-b9f11d935051 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:29.773021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:29.774213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:29.775036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:29.775427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] PATH_INFO: `/v3/users/8f9b3ddbad3943e68668332610615ff4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:29.783336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9b3ddbad3943e68668332610615ff4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:29.791609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:29.808685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 847/1690] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:29 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:29.813076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdf2d9-88c6-4c9c-89d1-061cc0cb78ba admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:29.907381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:29.911781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9b3ddbad3943e68668332610615ff4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.928538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9b3ddbad3943e68668332610615ff4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.933346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9b3ddbad3943e68668332610615ff4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.959703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9b3ddbad3943e68668332610615ff4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.980748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42fc64a-bd90-4278-b890-856062b26371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9b3ddbad3943e68668332610615ff4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:29.987998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdf2d9-88c6-4c9c-89d1-061cc0cb78ba admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:30.000902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 844/1691] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:29 2022] DELETE /identity/v3/users/8f9b3ddbad3943e68668332610615ff4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:34:30.006624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d6d1-fd2c-4f22-aa0c-74898157859b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.006947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d6d1-fd2c-4f22-aa0c-74898157859b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.007224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d6d1-fd2c-4f22-aa0c-74898157859b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.016103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f7a1d-bac8-4fd2-9341-934be8304c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:30.016742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f7a1d-bac8-4fd2-9341-934be8304c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.017024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f7a1d-bac8-4fd2-9341-934be8304c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.017298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f7a1d-bac8-4fd2-9341-934be8304c37 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.017947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f7a1d-bac8-4fd2-9341-934be8304c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:30.020109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f7a1d-bac8-4fd2-9341-934be8304c37 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:30.034978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4783d6d1-fd2c-4f22-aa0c-74898157859b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:30.036574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4783d6d1-fd2c-4f22-aa0c-74898157859b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:30.078006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 848/1692] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:29 2022] POST /identity/v3/users => generated 287 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:34:30.082319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f7a1d-bac8-4fd2-9341-934be8304c37 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:30.088192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2c2f7a1d-bac8-4fd2-9341-934be8304c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:30.125575 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f7a1d-bac8-4fd2-9341-934be8304c37 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:30.202284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 845/1693] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:30.259535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783d6d1-fd2c-4f22-aa0c-74898157859b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:30.261099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4783d6d1-fd2c-4f22-aa0c-74898157859b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:30.288240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b457a0-70a8-4358-af1c-9656784c8dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:30.289171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b457a0-70a8-4358-af1c-9656784c8dca admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.289597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b457a0-70a8-4358-af1c-9656784c8dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.290033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b457a0-70a8-4358-af1c-9656784c8dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.291044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b457a0-70a8-4358-af1c-9656784c8dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:30.293013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b457a0-70a8-4358-af1c-9656784c8dca admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:30.321661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 849/1694] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:34:30.330423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b457a0-70a8-4358-af1c-9656784c8dca admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:30.356970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b457a0-70a8-4358-af1c-9656784c8dca admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:30.367256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f77c86-bc47-4a27-bb9e-3ea6b0f4290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:30.369706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77c86-bc47-4a27-bb9e-3ea6b0f4290d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.370366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77c86-bc47-4a27-bb9e-3ea6b0f4290d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.375512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77c86-bc47-4a27-bb9e-3ea6b0f4290d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.375512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f77c86-bc47-4a27-bb9e-3ea6b0f4290d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:30.375512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f77c86-bc47-4a27-bb9e-3ea6b0f4290d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:30.407485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:30.438609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783d6d1-fd2c-4f22-aa0c-74898157859b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:30.444644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 850/1695] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:34:30.454352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1c23-881b-421c-86c2-168bc70b8234 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.454646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1c23-881b-421c-86c2-168bc70b8234 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.455025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fd0fe-3e38-4fe8-b71e-c4b5f265b975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:30.456109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fd0fe-3e38-4fe8-b71e-c4b5f265b975 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.456264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1c23-881b-421c-86c2-168bc70b8234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.458285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fd0fe-3e38-4fe8-b71e-c4b5f265b975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.460538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fd0fe-3e38-4fe8-b71e-c4b5f265b975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.483960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fd0fe-3e38-4fe8-b71e-c4b5f265b975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:30.485759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fd0fe-3e38-4fe8-b71e-c4b5f265b975 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:30.508530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 846/1696] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:30.516139 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fd0fe-3e38-4fe8-b71e-c4b5f265b975 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:30.518156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2e7b1c23-881b-421c-86c2-168bc70b8234 None None] MFA Rules not processed for user `ae5eae3f61ad4449b008c085ca01519e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:30.520340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2e7b1c23-881b-421c-86c2-168bc70b8234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:30.543314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fd0fe-3e38-4fe8-b71e-c4b5f265b975 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:30.550593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53a396-5c50-47d2-909c-2455eb45a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:30.551262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53a396-5c50-47d2-909c-2455eb45a092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.551543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53a396-5c50-47d2-909c-2455eb45a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.551816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53a396-5c50-47d2-909c-2455eb45a092 admin admin] PATH_INFO: `/v3/projects/93b359b3c9104916a1ebf16e245be3c7/users/da32656d22024940938bcd05cf039166/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.580110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53a396-5c50-47d2-909c-2455eb45a092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b359b3c9104916a1ebf16e245be3c7, user_id=da32656d22024940938bcd05cf039166, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:30.584490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53a396-5c50-47d2-909c-2455eb45a092 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:30.639128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 847/1697] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:30 2022] PUT /identity/v3/projects/93b359b3c9104916a1ebf16e245be3c7/users/da32656d22024940938bcd05cf039166/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:30.655452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ce0b2-6349-4ffd-b529-2ab8dd818d5b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.656205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ce0b2-6349-4ffd-b529-2ab8dd818d5b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.656848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ce0b2-6349-4ffd-b529-2ab8dd818d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.702070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 851/1698] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:30.706980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b1c23-881b-421c-86c2-168bc70b8234 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:30.709188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2e7b1c23-881b-421c-86c2-168bc70b8234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:30.741935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b1c23-881b-421c-86c2-168bc70b8234 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:30.747423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-150ce0b2-6349-4ffd-b529-2ab8dd818d5b None None] MFA Rules not processed for user `da32656d22024940938bcd05cf039166`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:30.749395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-150ce0b2-6349-4ffd-b529-2ab8dd818d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:30.835713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:30.896674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d557b9a-0769-4bfd-b455-969037f4890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:30.897427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d557b9a-0769-4bfd-b455-969037f4890e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.897805 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d557b9a-0769-4bfd-b455-969037f4890e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.898179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d557b9a-0769-4bfd-b455-969037f4890e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.898945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d557b9a-0769-4bfd-b455-969037f4890e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:30.900995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d557b9a-0769-4bfd-b455-969037f4890e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:30.914263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 848/1699] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:30.918575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ce0b2-6349-4ffd-b529-2ab8dd818d5b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:30.922860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-150ce0b2-6349-4ffd-b529-2ab8dd818d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:30.950780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ce0b2-6349-4ffd-b529-2ab8dd818d5b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:30.964153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:30.966334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:30.966922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:30.967474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] PATH_INFO: `/v3/users/cb56c43f806a45cca5e4cf0502234968` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:30.970720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb56c43f806a45cca5e4cf0502234968)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:30.972728 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 852/1700] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:30 2022] POST /identity/v3/projects => generated 403 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:30.973974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d557b9a-0769-4bfd-b455-969037f4890e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:30.975073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:31.073369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb56c43f806a45cca5e4cf0502234968'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:31.089446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb56c43f806a45cca5e4cf0502234968'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:31.090556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb56c43f806a45cca5e4cf0502234968'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:31.094192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d557b9a-0769-4bfd-b455-969037f4890e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:31.107158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3fed5-50ee-47d1-9d30-b6e40c7293e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:31.108162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3fed5-50ee-47d1-9d30-b6e40c7293e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.108506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3fed5-50ee-47d1-9d30-b6e40c7293e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.108794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3fed5-50ee-47d1-9d30-b6e40c7293e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.110174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3fed5-50ee-47d1-9d30-b6e40c7293e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:31.114281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3fed5-50ee-47d1-9d30-b6e40c7293e9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:31.115834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb56c43f806a45cca5e4cf0502234968'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:31.130775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb56c43f806a45cca5e4cf0502234968'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:31.154126 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 849/1701] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:30 2022] DELETE /identity/v3/users/cb56c43f806a45cca5e4cf0502234968 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:31.155387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:31.160545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:31.188960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 853/1702] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:30 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:31.194234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06e6c-010b-4e38-a36c-bab623ce1490 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.194532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06e6c-010b-4e38-a36c-bab623ce1490 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.199021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06e6c-010b-4e38-a36c-bab623ce1490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.247422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-67c06e6c-010b-4e38-a36c-bab623ce1490 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:31.248751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-67c06e6c-010b-4e38-a36c-bab623ce1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:31.255978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:31.325800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a82bf-c94f-4e09-8079-9349cdb43c43 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:31.386816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 854/1703] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:31.386816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1628de5-981d-4316-b1a7-e31e2e9292b3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.386816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1628de5-981d-4316-b1a7-e31e2e9292b3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.386816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1628de5-981d-4316-b1a7-e31e2e9292b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.439556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d1628de5-981d-4316-b1a7-e31e2e9292b3 None None] MFA Rules not processed for user `1479ebe2a7a7426d9ee1dafa37fbd0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:31.442918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d1628de5-981d-4316-b1a7-e31e2e9292b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:31.447831 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d21071-97b0-428b-96d4-abece1d863aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:31.448512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21071-97b0-428b-96d4-abece1d863aa admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.448833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21071-97b0-428b-96d4-abece1d863aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.449130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21071-97b0-428b-96d4-abece1d863aa admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.449894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d21071-97b0-428b-96d4-abece1d863aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:31.452613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d21071-97b0-428b-96d4-abece1d863aa admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:31.494434 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 850/1704] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:31 2022] POST /identity/v3/users => generated 308 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:31.495595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d21071-97b0-428b-96d4-abece1d863aa admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:31.498567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a7d21071-97b0-428b-96d4-abece1d863aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:31.512564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d21071-97b0-428b-96d4-abece1d863aa admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:31.515168 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:31.521028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7476fe-3e95-456a-9910-9626339f72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:31.521990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7476fe-3e95-456a-9910-9626339f72e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.523081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7476fe-3e95-456a-9910-9626339f72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.523570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7476fe-3e95-456a-9910-9626339f72e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.524534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7476fe-3e95-456a-9910-9626339f72e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:31.528384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7476fe-3e95-456a-9910-9626339f72e3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:31.585849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 855/1705] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:31.587060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1628de5-981d-4316-b1a7-e31e2e9292b3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:31.587213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 851/1706] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:31 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:31.588362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7476fe-3e95-456a-9910-9626339f72e3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:31.588874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d1628de5-981d-4316-b1a7-e31e2e9292b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:31.609334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7476fe-3e95-456a-9910-9626339f72e3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:31.623965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8de946-8c29-4ab3-b40a-74689b953984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:31.624600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8de946-8c29-4ab3-b40a-74689b953984 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.624881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8de946-8c29-4ab3-b40a-74689b953984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.625153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8de946-8c29-4ab3-b40a-74689b953984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.625810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8de946-8c29-4ab3-b40a-74689b953984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:31.627474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8de946-8c29-4ab3-b40a-74689b953984 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:31.654649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 852/1707] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:31.657048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032785e2-42e0-4689-a62a-bad9edd1e4b7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.657599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032785e2-42e0-4689-a62a-bad9edd1e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.657876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032785e2-42e0-4689-a62a-bad9edd1e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.705513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-032785e2-42e0-4689-a62a-bad9edd1e4b7 None None] MFA Rules not processed for user `1479ebe2a7a7426d9ee1dafa37fbd0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:31.711467 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-032785e2-42e0-4689-a62a-bad9edd1e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:31.720918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1628de5-981d-4316-b1a7-e31e2e9292b3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:31.727714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 853/1708] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:31.729759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032785e2-42e0-4689-a62a-bad9edd1e4b7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:31.730927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d6c2a-3883-4b96-a688-0de017210b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:31.731620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d6c2a-3883-4b96-a688-0de017210b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.731902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d6c2a-3883-4b96-a688-0de017210b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.732173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d6c2a-3883-4b96-a688-0de017210b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.753131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d6c2a-3883-4b96-a688-0de017210b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:31.755441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032785e2-42e0-4689-a62a-bad9edd1e4b7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:31.756931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d6c2a-3883-4b96-a688-0de017210b68 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:31.766570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9b69-c4f2-42cb-96f4-79167371ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:31.767768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9b69-c4f2-42cb-96f4-79167371ede0 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.768048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9b69-c4f2-42cb-96f4-79167371ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.770593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9b69-c4f2-42cb-96f4-79167371ede0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.772576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d9b69-c4f2-42cb-96f4-79167371ede0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:31.776446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d9b69-c4f2-42cb-96f4-79167371ede0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:31.779277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 856/1709] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:31.782213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d6c2a-3883-4b96-a688-0de017210b68 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:31.798728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 854/1710] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:31.806053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d6c2a-3883-4b96-a688-0de017210b68 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:31.807368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9b69-c4f2-42cb-96f4-79167371ede0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:31.810256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b33d9b69-c4f2-42cb-96f4-79167371ede0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:31.817501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f78fd-d81a-4d79-bba6-a5c93837264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:31.818108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f78fd-d81a-4d79-bba6-a5c93837264a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:31.818390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f78fd-d81a-4d79-bba6-a5c93837264a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:31.818664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f78fd-d81a-4d79-bba6-a5c93837264a admin admin] PATH_INFO: `/v3/projects/7116f9b411bb4217b662ab034881a24a/users/25735dbda7524dffa685db6fa2a71b30/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:31.851088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f78fd-d81a-4d79-bba6-a5c93837264a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7116f9b411bb4217b662ab034881a24a, user_id=25735dbda7524dffa685db6fa2a71b30, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:31.865453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f78fd-d81a-4d79-bba6-a5c93837264a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:31.899199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 857/1711] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:31 2022] PUT /identity/v3/projects/7116f9b411bb4217b662ab034881a24a/users/25735dbda7524dffa685db6fa2a71b30/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:31.899199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f78fd-d81a-4d79-bba6-a5c93837264a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:32.013600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9b69-c4f2-42cb-96f4-79167371ede0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:32.062216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:32.078768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f78fd-d81a-4d79-bba6-a5c93837264a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:32.090779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4372d-c40e-454c-80e1-bdcce99b9ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:32.091458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4372d-c40e-454c-80e1-bdcce99b9ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:32.091734 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4372d-c40e-454c-80e1-bdcce99b9ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:32.092073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4372d-c40e-454c-80e1-bdcce99b9ecb admin admin] PATH_INFO: `/v3/projects/2883f633282040bf817f898d6b4310d3/users/c6525e61c38f4361b341a1689baee414/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:32.110205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4372d-c40e-454c-80e1-bdcce99b9ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2883f633282040bf817f898d6b4310d3, user_id=c6525e61c38f4361b341a1689baee414, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:32.114903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4372d-c40e-454c-80e1-bdcce99b9ecb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:32.164845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 858/1712] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:31 2022] PUT /identity/v3/projects/2883f633282040bf817f898d6b4310d3/users/c6525e61c38f4361b341a1689baee414/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:32.169762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4372d-c40e-454c-80e1-bdcce99b9ecb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:32.271961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:32.308383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946673c-41df-4ef8-b386-55ad0c7fe459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:32.309189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946673c-41df-4ef8-b386-55ad0c7fe459 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:32.311040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946673c-41df-4ef8-b386-55ad0c7fe459 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:32.311435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946673c-41df-4ef8-b386-55ad0c7fe459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:32.314293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4372d-c40e-454c-80e1-bdcce99b9ecb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:32.332807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49902f69-612c-4e1f-b394-a03a51a08a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:32.333443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49902f69-612c-4e1f-b394-a03a51a08a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:32.333723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49902f69-612c-4e1f-b394-a03a51a08a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:32.333995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49902f69-612c-4e1f-b394-a03a51a08a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:32.334644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49902f69-612c-4e1f-b394-a03a51a08a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:32.336523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49902f69-612c-4e1f-b394-a03a51a08a66 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:32.373173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 859/1713] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:32.374207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49902f69-612c-4e1f-b394-a03a51a08a66 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:32.395511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49902f69-612c-4e1f-b394-a03a51a08a66 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:32.420757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da47ab-0eeb-4874-a71e-37fcac18a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:32.421396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da47ab-0eeb-4874-a71e-37fcac18a5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:32.421678 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da47ab-0eeb-4874-a71e-37fcac18a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:32.421952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da47ab-0eeb-4874-a71e-37fcac18a5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:32.422601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da47ab-0eeb-4874-a71e-37fcac18a5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:32.425124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da47ab-0eeb-4874-a71e-37fcac18a5ec admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:32.452479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 860/1714] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:32.457013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da47ab-0eeb-4874-a71e-37fcac18a5ec admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:32.492211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da47ab-0eeb-4874-a71e-37fcac18a5ec admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:32.527086 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6632-ccce-4132-89b5-7d72f179e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:32.527771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6632-ccce-4132-89b5-7d72f179e756 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:32.528051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6632-ccce-4132-89b5-7d72f179e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:32.528323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6632-ccce-4132-89b5-7d72f179e756 admin admin] PATH_INFO: `/v3/projects/7116f9b411bb4217b662ab034881a24a/users/25735dbda7524dffa685db6fa2a71b30/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:32.530291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f6632-ccce-4132-89b5-7d72f179e756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7116f9b411bb4217b662ab034881a24a, user_id=25735dbda7524dffa685db6fa2a71b30, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:32.534912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f6632-ccce-4132-89b5-7d72f179e756 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:32.559366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 861/1715] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:32 2022] PUT /identity/v3/projects/7116f9b411bb4217b662ab034881a24a/users/25735dbda7524dffa685db6fa2a71b30/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:32.562993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946673c-41df-4ef8-b386-55ad0c7fe459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:32.563600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6632-ccce-4132-89b5-7d72f179e756 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:32.563690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946673c-41df-4ef8-b386-55ad0c7fe459 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:32.587205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 855/1716] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:32.740537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6632-ccce-4132-89b5-7d72f179e756 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:32.755262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816604ef-1d4f-4770-b8bb-bd5aff591790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:32.756323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816604ef-1d4f-4770-b8bb-bd5aff591790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:32.756913 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816604ef-1d4f-4770-b8bb-bd5aff591790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:32.757329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816604ef-1d4f-4770-b8bb-bd5aff591790 admin admin] PATH_INFO: `/v3/projects/2883f633282040bf817f898d6b4310d3/users/c6525e61c38f4361b341a1689baee414/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:32.760786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816604ef-1d4f-4770-b8bb-bd5aff591790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2883f633282040bf817f898d6b4310d3, user_id=c6525e61c38f4361b341a1689baee414, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:32.767542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816604ef-1d4f-4770-b8bb-bd5aff591790 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:32.799820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a6371-09b3-479f-8b45-9cadb30ab2ba None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:32.800262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a6371-09b3-479f-8b45-9cadb30ab2ba None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:32.800643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a6371-09b3-479f-8b45-9cadb30ab2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:32.805620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 862/1717] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:32 2022] PUT /identity/v3/projects/2883f633282040bf817f898d6b4310d3/users/c6525e61c38f4361b341a1689baee414/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:32.837324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816604ef-1d4f-4770-b8bb-bd5aff591790 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:32.843279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-816604ef-1d4f-4770-b8bb-bd5aff591790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:32.868668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2d3a6371-09b3-479f-8b45-9cadb30ab2ba None None] MFA Rules not processed for user `c6525e61c38f4361b341a1689baee414`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:32.872024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2d3a6371-09b3-479f-8b45-9cadb30ab2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:32.991478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816604ef-1d4f-4770-b8bb-bd5aff591790 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:33.010102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:33.010807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:33.011088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:33.011361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] PATH_INFO: `/v3/projects/319223809f454b9491a981dc8fcef22b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:33.014217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=319223809f454b9491a981dc8fcef22b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:33.023143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:33.074207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 856/1718] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:33.087487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a6371-09b3-479f-8b45-9cadb30ab2ba None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:33.091430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2d3a6371-09b3-479f-8b45-9cadb30ab2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:33.142769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:33.146048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319223809f454b9491a981dc8fcef22b', 'request_id': 'req-018978dc-6c48-4605-8554-62af255e84fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:33.164671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319223809f454b9491a981dc8fcef22b', 'request_id': 'req-018978dc-6c48-4605-8554-62af255e84fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:33.175795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319223809f454b9491a981dc8fcef22b', 'request_id': 'req-018978dc-6c48-4605-8554-62af255e84fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:33.203408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] The token cache is being invalidate because project 319223809f454b9491a981dc8fcef22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:33.203750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:33.204552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-018978dc-6c48-4605-8554-62af255e84fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:33.208367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:33.210293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 863/1719] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:32 2022] DELETE /identity/v3/projects/319223809f454b9491a981dc8fcef22b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:34:33.215850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b018e0-88f7-4ac1-b8e9-1b5b0f67bb1b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:33.216242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b018e0-88f7-4ac1-b8e9-1b5b0f67bb1b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:33.216393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b018e0-88f7-4ac1-b8e9-1b5b0f67bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:33.258198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a6371-09b3-479f-8b45-9cadb30ab2ba None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:33.272438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-14b018e0-88f7-4ac1-b8e9-1b5b0f67bb1b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:33.273759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14b018e0-88f7-4ac1-b8e9-1b5b0f67bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:33.438350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6b56d-0f2a-40a9-bb83-bbc92b1bc91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:33.439655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b56d-0f2a-40a9-bb83-bbc92b1bc91e service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:33.439943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b56d-0f2a-40a9-bb83-bbc92b1bc91e service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:33.440808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b56d-0f2a-40a9-bb83-bbc92b1bc91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:33.445173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-77c6b56d-0f2a-40a9-bb83-bbc92b1bc91e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:33.513586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 864/1720] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:33.536560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9e7c1-cb66-4f7d-860c-41d695bbe885 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:33.536838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9e7c1-cb66-4f7d-860c-41d695bbe885 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:33.537185 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9e7c1-cb66-4f7d-860c-41d695bbe885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:33.616272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-21c9e7c1-cb66-4f7d-860c-41d695bbe885 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:33.617664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-21c9e7c1-cb66-4f7d-860c-41d695bbe885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:33.642729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 865/1721] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:33.644259 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9e7c1-cb66-4f7d-860c-41d695bbe885 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:33.649850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-21c9e7c1-cb66-4f7d-860c-41d695bbe885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:33.704695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9e7c1-cb66-4f7d-860c-41d695bbe885 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:33.730312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:33.730901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:33.731176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:33.731450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] PATH_INFO: `/v3/projects/ea17060e9a6f46079b75ccf263e4e500` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:33.733548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea17060e9a6f46079b75ccf263e4e500)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:33.736197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:33.743152 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6b56d-0f2a-40a9-bb83-bbc92b1bc91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:33.744642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6b56d-0f2a-40a9-bb83-bbc92b1bc91e service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:33.758972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 857/1722] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:33.761779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6b56d-0f2a-40a9-bb83-bbc92b1bc91e service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:33.808326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6b56d-0f2a-40a9-bb83-bbc92b1bc91e service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:33.820870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea8d62-f2b6-46cd-b59b-66ed21f336e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:33.821904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea8d62-f2b6-46cd-b59b-66ed21f336e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:33.822191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea8d62-f2b6-46cd-b59b-66ed21f336e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:33.822619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea8d62-f2b6-46cd-b59b-66ed21f336e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:33.823519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea8d62-f2b6-46cd-b59b-66ed21f336e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:33.823833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea8d62-f2b6-46cd-b59b-66ed21f336e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:33.827762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea8d62-f2b6-46cd-b59b-66ed21f336e1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:33.861798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 858/1723] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:33.866673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea8d62-f2b6-46cd-b59b-66ed21f336e1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:33.931922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea8d62-f2b6-46cd-b59b-66ed21f336e1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:33.948554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb271f-8351-4fdd-ac07-e4b40379e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:33.949201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb271f-8351-4fdd-ac07-e4b40379e96a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:33.949631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb271f-8351-4fdd-ac07-e4b40379e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:33.950108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb271f-8351-4fdd-ac07-e4b40379e96a admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:33.951353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb271f-8351-4fdd-ac07-e4b40379e96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:33.958037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb271f-8351-4fdd-ac07-e4b40379e96a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:34.010360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea17060e9a6f46079b75ccf263e4e500', 'request_id': 'req-251f191a-c5d0-4014-a9aa-22d61b0edb0d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.023196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 859/1724] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:33 2022] POST /identity/v3/projects => generated 397 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:34.024979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0708f-4b1e-41ca-82c1-614884abaf21 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:34.025123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0708f-4b1e-41ca-82c1-614884abaf21 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:34.025307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0708f-4b1e-41ca-82c1-614884abaf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:34.036558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea17060e9a6f46079b75ccf263e4e500', 'request_id': 'req-251f191a-c5d0-4014-a9aa-22d61b0edb0d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.058434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea17060e9a6f46079b75ccf263e4e500', 'request_id': 'req-251f191a-c5d0-4014-a9aa-22d61b0edb0d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.071949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-27b0708f-4b1e-41ca-82c1-614884abaf21 None None] MFA Rules not processed for user `439521dcf005417cb22a80dc340312ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:34.073616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-27b0708f-4b1e-41ca-82c1-614884abaf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:34.119554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] The token cache is being invalidate because project ea17060e9a6f46079b75ccf263e4e500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:34.121125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.127381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.134708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 866/1725] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:33 2022] DELETE /identity/v3/projects/ea17060e9a6f46079b75ccf263e4e500 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:34.135928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:34.138182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:34.227191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:34.244306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 860/1726] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:34.245308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0708f-4b1e-41ca-82c1-614884abaf21 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:34.246902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-27b0708f-4b1e-41ca-82c1-614884abaf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:34.387442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f191a-c5d0-4014-a9aa-22d61b0edb0d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:34.409392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:34.460302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0708f-4b1e-41ca-82c1-614884abaf21 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:34.468016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d027fa-c17e-4b90-aced-703f3f898154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:34.469094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d027fa-c17e-4b90-aced-703f3f898154 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:34.469426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d027fa-c17e-4b90-aced-703f3f898154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:34.469707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d027fa-c17e-4b90-aced-703f3f898154 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:34.470655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d027fa-c17e-4b90-aced-703f3f898154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:34.473325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d027fa-c17e-4b90-aced-703f3f898154 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:34.509749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 861/1727] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:34 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:34.510925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d027fa-c17e-4b90-aced-703f3f898154 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:34.517570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b0d027fa-c17e-4b90-aced-703f3f898154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:34.558180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d027fa-c17e-4b90-aced-703f3f898154 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:34.567367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:34.568501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:34.569008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:34.569511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] PATH_INFO: `/v3/users/fb9da276833c459695c9d1e12f2c0def` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:34.571128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9da276833c459695c9d1e12f2c0def)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:34.574070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:34.666369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f263c0-a706-4e94-95ad-bc059908492e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:34.669110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f263c0-a706-4e94-95ad-bc059908492e service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:34.669396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f263c0-a706-4e94-95ad-bc059908492e service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:34.669674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f263c0-a706-4e94-95ad-bc059908492e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:34.674145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d5f263c0-a706-4e94-95ad-bc059908492e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:34.718268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9da276833c459695c9d1e12f2c0def'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.735290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9da276833c459695c9d1e12f2c0def'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.736218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9da276833c459695c9d1e12f2c0def'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.769662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9da276833c459695c9d1e12f2c0def'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.791289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-13f0921a-bc8e-4689-95b5-6039fbcbc31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9da276833c459695c9d1e12f2c0def'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:34.822170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 862/1728] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:34 2022] DELETE /identity/v3/users/fb9da276833c459695c9d1e12f2c0def => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:34.824042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a630df-80b0-42a6-8076-e42a85fe894b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:34.824331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a630df-80b0-42a6-8076-e42a85fe894b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:34.824636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a630df-80b0-42a6-8076-e42a85fe894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:34.876001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e8a630df-80b0-42a6-8076-e42a85fe894b None None] MFA Rules not processed for user `439521dcf005417cb22a80dc340312ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:34.877300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e8a630df-80b0-42a6-8076-e42a85fe894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:34.929954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f263c0-a706-4e94-95ad-bc059908492e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:34.933865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f263c0-a706-4e94-95ad-bc059908492e service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:34.979286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 867/1729] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 843 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:34.980975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a784f83-66b6-4d0e-ada2-d1b472309763 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:34.985598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a784f83-66b6-4d0e-ada2-d1b472309763 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:34.986273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a784f83-66b6-4d0e-ada2-d1b472309763 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:34.988440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 868/1730] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 31 11:34:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:34:35.010929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a784f83-66b6-4d0e-ada2-d1b472309763 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:35.021463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6a784f83-66b6-4d0e-ada2-d1b472309763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:35.043390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 863/1731] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:35.057378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113c9a-4315-4343-b3b8-ae1167546fa4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:35.057667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113c9a-4315-4343-b3b8-ae1167546fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:35.057948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113c9a-4315-4343-b3b8-ae1167546fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:35.111091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:35.171641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5f113c9a-4315-4343-b3b8-ae1167546fa4 None None] MFA Rules not processed for user `e0f654bfe8364490a322b88433dd8fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:35.172895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5f113c9a-4315-4343-b3b8-ae1167546fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:35.271943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a784f83-66b6-4d0e-ada2-d1b472309763 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:35.282224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87789b-786c-4a9a-aed5-12d1594fa085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:35.283965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87789b-786c-4a9a-aed5-12d1594fa085 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:35.284317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87789b-786c-4a9a-aed5-12d1594fa085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:35.284703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87789b-786c-4a9a-aed5-12d1594fa085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:35.285533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87789b-786c-4a9a-aed5-12d1594fa085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:35.287305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87789b-786c-4a9a-aed5-12d1594fa085 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:35.305897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 864/1732] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:34:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:35.306826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f113c9a-4315-4343-b3b8-ae1167546fa4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:35.308485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5f113c9a-4315-4343-b3b8-ae1167546fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:35.327052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 869/1733] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:35.331456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87789b-786c-4a9a-aed5-12d1594fa085 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:35.355981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87789b-786c-4a9a-aed5-12d1594fa085 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:35.375242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158c82b-cb5c-48b2-907e-c661b422e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:35.376054 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158c82b-cb5c-48b2-907e-c661b422e116 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:35.376505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158c82b-cb5c-48b2-907e-c661b422e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:35.378068 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158c82b-cb5c-48b2-907e-c661b422e116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:35.379898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158c82b-cb5c-48b2-907e-c661b422e116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:35.401281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158c82b-cb5c-48b2-907e-c661b422e116 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:35.454225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 870/1734] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:35.457164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158c82b-cb5c-48b2-907e-c661b422e116 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:35.461574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f158c82b-cb5c-48b2-907e-c661b422e116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:35.495294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f113c9a-4315-4343-b3b8-ae1167546fa4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:35.503055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fc515-1796-4b44-a757-4f61d6ba9370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:35.503638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fc515-1796-4b44-a757-4f61d6ba9370 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:35.503937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fc515-1796-4b44-a757-4f61d6ba9370 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:35.504257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fc515-1796-4b44-a757-4f61d6ba9370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:35.505146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158c82b-cb5c-48b2-907e-c661b422e116 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:35.507045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-362fc515-1796-4b44-a757-4f61d6ba9370 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:35.511856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163de37-0e85-4085-926f-def34f7ab846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:35.512619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163de37-0e85-4085-926f-def34f7ab846 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:35.513019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163de37-0e85-4085-926f-def34f7ab846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:35.513194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163de37-0e85-4085-926f-def34f7ab846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:35.524315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163de37-0e85-4085-926f-def34f7ab846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:35.524625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fc515-1796-4b44-a757-4f61d6ba9370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:35.525840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163de37-0e85-4085-926f-def34f7ab846 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:35.526991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fc515-1796-4b44-a757-4f61d6ba9370 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:35.546459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 871/1735] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:35.547583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163de37-0e85-4085-926f-def34f7ab846 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:35.548255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 865/1736] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:35.567146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163de37-0e85-4085-926f-def34f7ab846 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:35.576479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163622f-aba9-423a-b345-38368157ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:35.577362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163622f-aba9-423a-b345-38368157ebdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:35.577777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163622f-aba9-423a-b345-38368157ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:35.578188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163622f-aba9-423a-b345-38368157ebdd admin admin] PATH_INFO: `/v3/projects/a31d4dac1f3541b29cbc4f1244dd411e/users/e3b1ecaaee7e4849b62b57e399699155/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:35.600020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163622f-aba9-423a-b345-38368157ebdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31d4dac1f3541b29cbc4f1244dd411e, user_id=e3b1ecaaee7e4849b62b57e399699155, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:35.605054 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163622f-aba9-423a-b345-38368157ebdd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:35.630750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 872/1737] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:35 2022] PUT /identity/v3/projects/a31d4dac1f3541b29cbc4f1244dd411e/users/e3b1ecaaee7e4849b62b57e399699155/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:35.642400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f693627-152a-40fe-a5af-4a10c45e3581 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:35.642822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f693627-152a-40fe-a5af-4a10c45e3581 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:35.643737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f693627-152a-40fe-a5af-4a10c45e3581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:35.718936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4f693627-152a-40fe-a5af-4a10c45e3581 None None] MFA Rules not processed for user `e3b1ecaaee7e4849b62b57e399699155`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:35.720897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4f693627-152a-40fe-a5af-4a10c45e3581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:35.852108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 866/1738] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:35.852855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163622f-aba9-423a-b345-38368157ebdd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:35.869048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:35.940477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163622f-aba9-423a-b345-38368157ebdd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:35.947348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59a76-f60a-42e9-a4ac-d0796524ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:35.948226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59a76-f60a-42e9-a4ac-d0796524ee18 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:35.948646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59a76-f60a-42e9-a4ac-d0796524ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:35.949064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59a76-f60a-42e9-a4ac-d0796524ee18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:35.949978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d59a76-f60a-42e9-a4ac-d0796524ee18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:35.952203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d59a76-f60a-42e9-a4ac-d0796524ee18 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:35.991347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 873/1739] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:35 2022] POST /identity/v3/projects => generated 401 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:34:35.996191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f693627-152a-40fe-a5af-4a10c45e3581 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:36.011180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f693627-152a-40fe-a5af-4a10c45e3581 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:36.028816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:36.092868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbcf2e-7267-4f4a-91a9-93f8e44f2daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:36.094154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbcf2e-7267-4f4a-91a9-93f8e44f2daa admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.094628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbcf2e-7267-4f4a-91a9-93f8e44f2daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.095117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbcf2e-7267-4f4a-91a9-93f8e44f2daa admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.096044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbcf2e-7267-4f4a-91a9-93f8e44f2daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:36.099283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbcf2e-7267-4f4a-91a9-93f8e44f2daa admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:36.142319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 867/1740] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:35 2022] POST /identity/v3/users => generated 307 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:36.146779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59a76-f60a-42e9-a4ac-d0796524ee18 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:36.164889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59a76-f60a-42e9-a4ac-d0796524ee18 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:36.171397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4354-7ab3-439c-bfc7-985eba8ff3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:36.172689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4354-7ab3-439c-bfc7-985eba8ff3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.173179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4354-7ab3-439c-bfc7-985eba8ff3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.173656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4354-7ab3-439c-bfc7-985eba8ff3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.176028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4354-7ab3-439c-bfc7-985eba8ff3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:36.178281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4354-7ab3-439c-bfc7-985eba8ff3ef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:36.203709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbcf2e-7267-4f4a-91a9-93f8e44f2daa admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:36.218156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 874/1741] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:36.220884 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbcf2e-7267-4f4a-91a9-93f8e44f2daa admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:36.229007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ff4e-35a0-4976-a961-367672d62dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:36.229863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ff4e-35a0-4976-a961-367672d62dae admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.230247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ff4e-35a0-4976-a961-367672d62dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.230760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ff4e-35a0-4976-a961-367672d62dae admin admin] PATH_INFO: `/v3/projects/80022d4d53bf425ea686f2ebb1823fd6/users/3c0f14fd498041558b55835688aecb2e/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.259495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ff4e-35a0-4976-a961-367672d62dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=80022d4d53bf425ea686f2ebb1823fd6, user_id=3c0f14fd498041558b55835688aecb2e, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:36.263420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ff4e-35a0-4976-a961-367672d62dae admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:36.287603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 868/1742] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:36 2022] PUT /identity/v3/projects/80022d4d53bf425ea686f2ebb1823fd6/users/3c0f14fd498041558b55835688aecb2e/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:36.291759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4354-7ab3-439c-bfc7-985eba8ff3ef admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:36.313201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c397bc-ee18-4667-b53a-84c4588a44aa None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.316962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4354-7ab3-439c-bfc7-985eba8ff3ef admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:36.317550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c397bc-ee18-4667-b53a-84c4588a44aa None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.318998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c397bc-ee18-4667-b53a-84c4588a44aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.376883 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-89c397bc-ee18-4667-b53a-84c4588a44aa None None] MFA Rules not processed for user `a7c9275aeee8438fa1fde55f207fd730`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:36.379561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-89c397bc-ee18-4667-b53a-84c4588a44aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:36.480520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c384d67-a48b-4f7c-acdb-7c96d6c061d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:36.481151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c384d67-a48b-4f7c-acdb-7c96d6c061d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.481151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c384d67-a48b-4f7c-acdb-7c96d6c061d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.481339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c384d67-a48b-4f7c-acdb-7c96d6c061d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.481966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c384d67-a48b-4f7c-acdb-7c96d6c061d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:36.484099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c384d67-a48b-4f7c-acdb-7c96d6c061d1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:36.498727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 869/1743] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:36.498727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b83c6-15a7-46b2-a907-5b988e89481b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.498727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b83c6-15a7-46b2-a907-5b988e89481b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.498727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b83c6-15a7-46b2-a907-5b988e89481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.505883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 875/1744] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:36.507017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c384d67-a48b-4f7c-acdb-7c96d6c061d1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:36.576723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c384d67-a48b-4f7c-acdb-7c96d6c061d1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:36.579578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1b0b83c6-15a7-46b2-a907-5b988e89481b None None] MFA Rules not processed for user `09e1a58dc35c49d4b5cccd6d91b9ef47`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:36.586993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1b0b83c6-15a7-46b2-a907-5b988e89481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:36.629241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd8146-33cc-4bf7-a833-8e39abf40a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:36.639460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd8146-33cc-4bf7-a833-8e39abf40a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.639927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd8146-33cc-4bf7-a833-8e39abf40a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.640635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd8146-33cc-4bf7-a833-8e39abf40a64 admin admin] PATH_INFO: `/v3/projects/80022d4d53bf425ea686f2ebb1823fd6/users/3c0f14fd498041558b55835688aecb2e/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.647804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd8146-33cc-4bf7-a833-8e39abf40a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80022d4d53bf425ea686f2ebb1823fd6, user_id=3c0f14fd498041558b55835688aecb2e, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:36.650478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd8146-33cc-4bf7-a833-8e39abf40a64 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:36.692125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 876/1745] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:36 2022] PUT /identity/v3/projects/80022d4d53bf425ea686f2ebb1823fd6/users/3c0f14fd498041558b55835688aecb2e/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:36.694361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0235a4-178b-48ab-86e7-62f159443bd0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.694812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0235a4-178b-48ab-86e7-62f159443bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.695221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0235a4-178b-48ab-86e7-62f159443bd0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.696898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 877/1746] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 31 11:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:34:36.706339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c888ac3-6417-4934-8eee-94d850ad98cf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.706512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c888ac3-6417-4934-8eee-94d850ad98cf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.713405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c888ac3-6417-4934-8eee-94d850ad98cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.715506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 870/1747] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:36.717079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f693ec-2d83-4b81-8040-317d4fc36e63 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.717505 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f693ec-2d83-4b81-8040-317d4fc36e63 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.717788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f693ec-2d83-4b81-8040-317d4fc36e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:36.733565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:36.759018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0c888ac3-6417-4934-8eee-94d850ad98cf None None] MFA Rules not processed for user `e0f654bfe8364490a322b88433dd8fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:36.762443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c888ac3-6417-4934-8eee-94d850ad98cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:36.794394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-19f693ec-2d83-4b81-8040-317d4fc36e63 None None] MFA Rules not processed for user `3c0f14fd498041558b55835688aecb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:36.794394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-19f693ec-2d83-4b81-8040-317d4fc36e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:36.901647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 878/1748] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:34:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:36.902787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c888ac3-6417-4934-8eee-94d850ad98cf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:36.905104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c888ac3-6417-4934-8eee-94d850ad98cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:36.940940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:36.975352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 871/1749] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:36.979867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b76384-6f49-4ca1-b2d5-b450bbe359f7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:36.981451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b76384-6f49-4ca1-b2d5-b450bbe359f7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:36.981790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b76384-6f49-4ca1-b2d5-b450bbe359f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:37.046635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c888ac3-6417-4934-8eee-94d850ad98cf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:37.063288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:37.064333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:37.064754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:37.066148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] PATH_INFO: `/v3/projects/a6ba533cef3d49d38e356c2dcd771145` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:37.069415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ba533cef3d49d38e356c2dcd771145)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:37.074035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:37.086321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b7b76384-6f49-4ca1-b2d5-b450bbe359f7 None None] MFA Rules not processed for user `25735dbda7524dffa685db6fa2a71b30`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:37.087319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b7b76384-6f49-4ca1-b2d5-b450bbe359f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.238431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ba533cef3d49d38e356c2dcd771145', 'request_id': 'req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:37.242524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 872/1750] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:37.243230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b76384-6f49-4ca1-b2d5-b450bbe359f7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:37.246893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b7b76384-6f49-4ca1-b2d5-b450bbe359f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.257683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ba533cef3d49d38e356c2dcd771145', 'request_id': 'req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:37.269612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ba533cef3d49d38e356c2dcd771145', 'request_id': 'req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:37.306901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b76384-6f49-4ca1-b2d5-b450bbe359f7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:37.310245 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] The token cache is being invalidate because project a6ba533cef3d49d38e356c2dcd771145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:37.310714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:37.313595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:37.317184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 879/1751] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:36 2022] DELETE /identity/v3/projects/a6ba533cef3d49d38e356c2dcd771145 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:37.320058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:37.323511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.420554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:37.421350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:37.421934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:37.422352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:37.426209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.435952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a020e3-62e1-4832-a8fc-ff234ddd8ce4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:37.441778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:37.444664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:37.445810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:37.446247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:37.446467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:37.447866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:37.448618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.492079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 873/1752] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:37.493351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:37.496674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.551857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:37.590286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:37.596935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:37.601808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:37.625834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 880/1753] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:37 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:37.629111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:37.631961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.734848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ae4da-eaf9-431c-bf12-634fed21aa52 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:37.745972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c0873-899f-4d15-b620-d26ae2e8fb22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:37.747908 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c0873-899f-4d15-b620-d26ae2e8fb22 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:37.748201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c0873-899f-4d15-b620-d26ae2e8fb22 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:37.748485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c0873-899f-4d15-b620-d26ae2e8fb22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:37.756288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6f3c0873-899f-4d15-b620-d26ae2e8fb22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.822743 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebffa1-a375-4581-b979-563169e7f36d service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:37.830318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b5c50-9da0-486f-9f01-a064197a88f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:37.831029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5c50-9da0-486f-9f01-a064197a88f9 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:37.832653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5c50-9da0-486f-9f01-a064197a88f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:37.832939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5c50-9da0-486f-9f01-a064197a88f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:37.836794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f34b5c50-9da0-486f-9f01-a064197a88f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.854027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b5c50-9da0-486f-9f01-a064197a88f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:37.855709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b5c50-9da0-486f-9f01-a064197a88f9 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:37.906011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 881/1754] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:37.914243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95402c-bb79-4092-8794-c44419d71d07 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:37.916903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95402c-bb79-4092-8794-c44419d71d07 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:37.917869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95402c-bb79-4092-8794-c44419d71d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:37.957595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c0873-899f-4d15-b620-d26ae2e8fb22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:37.959941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c0873-899f-4d15-b620-d26ae2e8fb22 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:37.974473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6f95402c-bb79-4092-8794-c44419d71d07 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:37.975891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6f95402c-bb79-4092-8794-c44419d71d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:37.980959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 874/1755] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:37.982415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c0873-899f-4d15-b620-d26ae2e8fb22 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:38.032283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c0873-899f-4d15-b620-d26ae2e8fb22 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:38.043869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302674b-4f5b-4352-9ddc-ec76253f6623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:38.044489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302674b-4f5b-4352-9ddc-ec76253f6623 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:38.044774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302674b-4f5b-4352-9ddc-ec76253f6623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:38.045049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302674b-4f5b-4352-9ddc-ec76253f6623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:38.053484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6302674b-4f5b-4352-9ddc-ec76253f6623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:38.167454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 882/1756] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:38.168141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95402c-bb79-4092-8794-c44419d71d07 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:38.216153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95402c-bb79-4092-8794-c44419d71d07 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:38.241260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdabc2-31fe-4481-81c5-8ee558c80841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:38.241897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdabc2-31fe-4481-81c5-8ee558c80841 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:38.242184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdabc2-31fe-4481-81c5-8ee558c80841 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:38.242452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdabc2-31fe-4481-81c5-8ee558c80841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:38.264194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6bcdabc2-31fe-4481-81c5-8ee558c80841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:38.320374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302674b-4f5b-4352-9ddc-ec76253f6623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:38.325290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302674b-4f5b-4352-9ddc-ec76253f6623 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:38.354006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 875/1757] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:38.356731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da7fd-1ac9-4db0-baed-20e68ca432d8 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:38.357028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da7fd-1ac9-4db0-baed-20e68ca432d8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:38.359336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da7fd-1ac9-4db0-baed-20e68ca432d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:38.416652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ec4da7fd-1ac9-4db0-baed-20e68ca432d8 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:38.417923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ec4da7fd-1ac9-4db0-baed-20e68ca432d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:38.441312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 876/1758] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:38.446939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4da7fd-1ac9-4db0-baed-20e68ca432d8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:38.450965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdabc2-31fe-4481-81c5-8ee558c80841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:38.454618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdabc2-31fe-4481-81c5-8ee558c80841 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:38.469448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4da7fd-1ac9-4db0-baed-20e68ca432d8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:38.487979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697a93a-b5de-4795-9cb8-e47a363a122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:38.488611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697a93a-b5de-4795-9cb8-e47a363a122e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:38.488892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697a93a-b5de-4795-9cb8-e47a363a122e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:38.492216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697a93a-b5de-4795-9cb8-e47a363a122e admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:38.492939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697a93a-b5de-4795-9cb8-e47a363a122e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:38.496783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697a93a-b5de-4795-9cb8-e47a363a122e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:38.503459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697a93a-b5de-4795-9cb8-e47a363a122e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:38.507354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 883/1759] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:38.568166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 877/1760] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:38.571319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdabc2-31fe-4481-81c5-8ee558c80841 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:38.588045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdabc2-31fe-4481-81c5-8ee558c80841 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:38.617543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49305e2-b3e5-46a0-bf5b-7153ac620278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:38.618348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49305e2-b3e5-46a0-bf5b-7153ac620278 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:38.618818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49305e2-b3e5-46a0-bf5b-7153ac620278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:38.619239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49305e2-b3e5-46a0-bf5b-7153ac620278 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:38.620132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49305e2-b3e5-46a0-bf5b-7153ac620278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:38.624027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49305e2-b3e5-46a0-bf5b-7153ac620278 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:38.762670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697a93a-b5de-4795-9cb8-e47a363a122e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:38.774897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 884/1761] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:38 2022] POST /identity/v3/projects => generated 391 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:38.776821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697a93a-b5de-4795-9cb8-e47a363a122e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:38.935104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:39.090437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aece78e-9151-475c-a72a-954f70bb9504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:39.091312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aece78e-9151-475c-a72a-954f70bb9504 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:39.091439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aece78e-9151-475c-a72a-954f70bb9504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:39.091635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aece78e-9151-475c-a72a-954f70bb9504 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:39.094610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aece78e-9151-475c-a72a-954f70bb9504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:39.097057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e58076-99cc-4424-9fdc-c6f3b35a2ca9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:39.097607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e58076-99cc-4424-9fdc-c6f3b35a2ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:39.098083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e58076-99cc-4424-9fdc-c6f3b35a2ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:39.102801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aece78e-9151-475c-a72a-954f70bb9504 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:39.118645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:39.188886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f0e58076-99cc-4424-9fdc-c6f3b35a2ca9 None None] MFA Rules not processed for user `1479ebe2a7a7426d9ee1dafa37fbd0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:39.194609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f0e58076-99cc-4424-9fdc-c6f3b35a2ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:39.201220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 878/1762] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:38 2022] POST /identity/v3/users => generated 296 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:39.203731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aece78e-9151-475c-a72a-954f70bb9504 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:39.246541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aece78e-9151-475c-a72a-954f70bb9504 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:39.253497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8204c-6510-4810-99ae-352cdab20d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:39.255110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8204c-6510-4810-99ae-352cdab20d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:39.255483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8204c-6510-4810-99ae-352cdab20d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:39.255865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8204c-6510-4810-99ae-352cdab20d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:39.256804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8204c-6510-4810-99ae-352cdab20d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:39.259339 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8204c-6510-4810-99ae-352cdab20d1b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:39.277838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 879/1763] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:39.283929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8204c-6510-4810-99ae-352cdab20d1b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:39.315799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8204c-6510-4810-99ae-352cdab20d1b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:39.331894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8df89-395e-417f-959d-5702cf00931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:39.332851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8df89-395e-417f-959d-5702cf00931e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:39.348982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8df89-395e-417f-959d-5702cf00931e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:39.351537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8df89-395e-417f-959d-5702cf00931e admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:39.353381 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8df89-395e-417f-959d-5702cf00931e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:39.366782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8df89-395e-417f-959d-5702cf00931e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:39.428086 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 885/1764] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:39.431042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e58076-99cc-4424-9fdc-c6f3b35a2ca9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:39.435166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 880/1765] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:39.500432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e58076-99cc-4424-9fdc-c6f3b35a2ca9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:39.533415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557ad14-95a7-4bd9-87db-52f0662ae61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:39.536251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ad14-95a7-4bd9-87db-52f0662ae61b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:39.539952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ad14-95a7-4bd9-87db-52f0662ae61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:39.543383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ad14-95a7-4bd9-87db-52f0662ae61b admin admin] PATH_INFO: `/v3/projects/f605a8310be94d859c99ad38b85df3f0/users/2181013f826e4083a7d43b442102809f/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:39.585112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3608d-b495-4ec1-b6a2-ce0ecbf6005a None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:39.585617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3608d-b495-4ec1-b6a2-ce0ecbf6005a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:39.586103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3608d-b495-4ec1-b6a2-ce0ecbf6005a None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:39.587770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 881/1766] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:34:39.643180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557ad14-95a7-4bd9-87db-52f0662ae61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f605a8310be94d859c99ad38b85df3f0, user_id=2181013f826e4083a7d43b442102809f, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:39.652918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f9208-cce9-4562-b616-6534ae0bf8c3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:39.653207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f9208-cce9-4562-b616-6534ae0bf8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:39.654673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f9208-cce9-4562-b616-6534ae0bf8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:39.660777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557ad14-95a7-4bd9-87db-52f0662ae61b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:39.709484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 886/1767] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:39 2022] PUT /identity/v3/projects/f605a8310be94d859c99ad38b85df3f0/users/2181013f826e4083a7d43b442102809f/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:39.720171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bc1bd-afe8-4ec9-b6aa-465128e628ed None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:39.720592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bc1bd-afe8-4ec9-b6aa-465128e628ed None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:39.720981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bc1bd-afe8-4ec9-b6aa-465128e628ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:39.734451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f14f9208-cce9-4562-b616-6534ae0bf8c3 None None] MFA Rules not processed for user `cc99489aa0e14928871b6f7b2c955068`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:39.738404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f14f9208-cce9-4562-b616-6534ae0bf8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:39.849002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-307bc1bd-afe8-4ec9-b6aa-465128e628ed None None] MFA Rules not processed for user `2181013f826e4083a7d43b442102809f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:39.853885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-307bc1bd-afe8-4ec9-b6aa-465128e628ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:40.004127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 882/1768] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:34:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:40.011180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 887/1769] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:40.015411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f9208-cce9-4562-b616-6534ae0bf8c3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:40.041766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bc1bd-afe8-4ec9-b6aa-465128e628ed None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:40.068856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bc1bd-afe8-4ec9-b6aa-465128e628ed None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:40.084690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d20b8-8886-492b-a253-b4250548aca2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:40.085918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d20b8-8886-492b-a253-b4250548aca2 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:40.088013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d20b8-8886-492b-a253-b4250548aca2 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:40.089934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d20b8-8886-492b-a253-b4250548aca2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:40.115624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d20b8-8886-492b-a253-b4250548aca2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:40.120108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d20b8-8886-492b-a253-b4250548aca2 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:40.153783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 888/1770] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:40.220724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f9208-cce9-4562-b616-6534ae0bf8c3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:40.237325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e6796-c0d0-4999-a610-c9559764b956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:40.238059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e6796-c0d0-4999-a610-c9559764b956 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:40.238503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e6796-c0d0-4999-a610-c9559764b956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:40.238820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e6796-c0d0-4999-a610-c9559764b956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:40.239513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e6796-c0d0-4999-a610-c9559764b956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:40.241576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e6796-c0d0-4999-a610-c9559764b956 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:40.345983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 883/1771] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:40 2022] POST /identity/v3/projects => generated 393 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:34:40.352055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d20b8-8886-492b-a253-b4250548aca2 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:40.376711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d20b8-8886-492b-a253-b4250548aca2 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:40.609169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff77dd0-2443-4e4a-a26d-02c315c6a69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:40.610884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff77dd0-2443-4e4a-a26d-02c315c6a69a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:40.612887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff77dd0-2443-4e4a-a26d-02c315c6a69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:40.614009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff77dd0-2443-4e4a-a26d-02c315c6a69a admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:40.618969 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff77dd0-2443-4e4a-a26d-02c315c6a69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:40.624107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff77dd0-2443-4e4a-a26d-02c315c6a69a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:40.704383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:40.745426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e6796-c0d0-4999-a610-c9559764b956 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:40.751954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 889/1772] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:40 2022] POST /identity/v3/users => generated 303 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:40.759113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e6796-c0d0-4999-a610-c9559764b956 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:40.783512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21f08-312d-429f-8e10-bed89393dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:40.786019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21f08-312d-429f-8e10-bed89393dffa admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:40.787057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21f08-312d-429f-8e10-bed89393dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:40.787959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21f08-312d-429f-8e10-bed89393dffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:40.790456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e21f08-312d-429f-8e10-bed89393dffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:40.793322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e21f08-312d-429f-8e10-bed89393dffa admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:40.820162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 884/1773] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:34:40.824083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff77dd0-2443-4e4a-a26d-02c315c6a69a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:40.841585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff77dd0-2443-4e4a-a26d-02c315c6a69a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:40.882376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d115e-45e8-4067-8af5-acb6e46c5312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:40.883309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d115e-45e8-4067-8af5-acb6e46c5312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:40.884936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d115e-45e8-4067-8af5-acb6e46c5312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:40.885606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d115e-45e8-4067-8af5-acb6e46c5312 admin admin] PATH_INFO: `/v3/projects/d9fd70aefab74231b2573601988bbff9/users/650b58de092447ba9b2a5cfe179a8700/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:40.935285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d115e-45e8-4067-8af5-acb6e46c5312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fd70aefab74231b2573601988bbff9, user_id=650b58de092447ba9b2a5cfe179a8700, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:40.939388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d115e-45e8-4067-8af5-acb6e46c5312 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:40.973948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21f08-312d-429f-8e10-bed89393dffa admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:40.975098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 890/1774] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:40 2022] PUT /identity/v3/projects/d9fd70aefab74231b2573601988bbff9/users/650b58de092447ba9b2a5cfe179a8700/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:40.997420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21f08-312d-429f-8e10-bed89393dffa admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:41.019271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:41.182194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46067313-bc8a-4529-891d-32f9e0168321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:41.183314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46067313-bc8a-4529-891d-32f9e0168321 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:41.183599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46067313-bc8a-4529-891d-32f9e0168321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:41.183874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46067313-bc8a-4529-891d-32f9e0168321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:41.194060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46067313-bc8a-4529-891d-32f9e0168321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:41.199780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46067313-bc8a-4529-891d-32f9e0168321 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:41.233354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 885/1775] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:41.235345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d115e-45e8-4067-8af5-acb6e46c5312 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:41.253354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d115e-45e8-4067-8af5-acb6e46c5312 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:41.264668 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333613a-4a5f-4229-a448-988c0b2cb142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:41.266716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333613a-4a5f-4229-a448-988c0b2cb142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:41.267299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333613a-4a5f-4229-a448-988c0b2cb142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:41.268023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333613a-4a5f-4229-a448-988c0b2cb142 admin admin] PATH_INFO: `/v3/projects/d9fd70aefab74231b2573601988bbff9/users/650b58de092447ba9b2a5cfe179a8700/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:41.270784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333613a-4a5f-4229-a448-988c0b2cb142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fd70aefab74231b2573601988bbff9, user_id=650b58de092447ba9b2a5cfe179a8700, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:41.274017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333613a-4a5f-4229-a448-988c0b2cb142 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:41.349206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 891/1776] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:41 2022] PUT /identity/v3/projects/d9fd70aefab74231b2573601988bbff9/users/650b58de092447ba9b2a5cfe179a8700/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:41.350327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18064eed-4fce-48e9-819e-9d73e1c1cd29 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:41.350616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18064eed-4fce-48e9-819e-9d73e1c1cd29 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:41.350913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18064eed-4fce-48e9-819e-9d73e1c1cd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:41.412377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-18064eed-4fce-48e9-819e-9d73e1c1cd29 None None] MFA Rules not processed for user `650b58de092447ba9b2a5cfe179a8700`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:41.413968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-18064eed-4fce-48e9-819e-9d73e1c1cd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:41.662634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333613a-4a5f-4229-a448-988c0b2cb142 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:41.665199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4333613a-4a5f-4229-a448-988c0b2cb142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:41.728704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 886/1777] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:41.772993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18064eed-4fce-48e9-819e-9d73e1c1cd29 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:41.921875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18064eed-4fce-48e9-819e-9d73e1c1cd29 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:41.935219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd758e5-5796-40ac-a839-78ad8225271c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:41.936106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd758e5-5796-40ac-a839-78ad8225271c service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:41.937657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd758e5-5796-40ac-a839-78ad8225271c service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:41.938115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd758e5-5796-40ac-a839-78ad8225271c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:41.954192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333613a-4a5f-4229-a448-988c0b2cb142 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:41.988899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd758e5-5796-40ac-a839-78ad8225271c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:41.990376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd758e5-5796-40ac-a839-78ad8225271c service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:41.994967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:41.995632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:41.995918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:41.996193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] PATH_INFO: `/v3/users/ae5eae3f61ad4449b008c085ca01519e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:41.998992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5eae3f61ad4449b008c085ca01519e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:42.001011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:42.030328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 887/1778] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:42.223598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5eae3f61ad4449b008c085ca01519e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:42.228359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd758e5-5796-40ac-a839-78ad8225271c service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:42.239324 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd758e5-5796-40ac-a839-78ad8225271c service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:42.254179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2261b7c-d81a-46d0-8942-78c55b228588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:42.256435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2261b7c-d81a-46d0-8942-78c55b228588 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:42.258364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2261b7c-d81a-46d0-8942-78c55b228588 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:42.260945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2261b7c-d81a-46d0-8942-78c55b228588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:42.287254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5eae3f61ad4449b008c085ca01519e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:42.344445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5eae3f61ad4449b008c085ca01519e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:42.371250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5eae3f61ad4449b008c085ca01519e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:42.374479 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-747d996d-205e-4d8e-b4f1-db29b7eea898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5eae3f61ad4449b008c085ca01519e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:42.391044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 892/1779] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:41 2022] DELETE /identity/v3/users/ae5eae3f61ad4449b008c085ca01519e => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:42.413572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:42.510722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2261b7c-d81a-46d0-8942-78c55b228588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:42.512531 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2261b7c-d81a-46d0-8942-78c55b228588 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:42.560607 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 888/1780] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:43.172317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b25e0-3921-43ad-9bb6-d0dc2cca9ecb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:43.172856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b25e0-3921-43ad-9bb6-d0dc2cca9ecb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:43.172856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b25e0-3921-43ad-9bb6-d0dc2cca9ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:43.307898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-341b25e0-3921-43ad-9bb6-d0dc2cca9ecb None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:43.317626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-341b25e0-3921-43ad-9bb6-d0dc2cca9ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:43.326056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:43.631632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 893/1781] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:34:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:43.906907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2261b7c-d81a-46d0-8942-78c55b228588 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:43.908543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f2261b7c-d81a-46d0-8942-78c55b228588 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:44.161283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2261b7c-d81a-46d0-8942-78c55b228588 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:44.300480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791071a-f8e9-498a-adc0-4f2a87538689 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:44.301445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791071a-f8e9-498a-adc0-4f2a87538689 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:44.301937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791071a-f8e9-498a-adc0-4f2a87538689 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:44.302450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791071a-f8e9-498a-adc0-4f2a87538689 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:44.319811 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791071a-f8e9-498a-adc0-4f2a87538689 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:44.322098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791071a-f8e9-498a-adc0-4f2a87538689 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:44.340801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 889/1782] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:34:44.425788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b25e0-3921-43ad-9bb6-d0dc2cca9ecb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:44.427568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-341b25e0-3921-43ad-9bb6-d0dc2cca9ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:44.623397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b25e0-3921-43ad-9bb6-d0dc2cca9ecb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:44.647648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:44.653614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:44.661400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:44.661841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] PATH_INFO: `/v3/projects/e187e3b7894b4cb09a3807bdbea145fc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:44.663384 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e187e3b7894b4cb09a3807bdbea145fc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:44.665700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:44.796742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e187e3b7894b4cb09a3807bdbea145fc', 'request_id': 'req-52f57db9-9daf-420d-af8c-3f28329a61cf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:44.815586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e187e3b7894b4cb09a3807bdbea145fc', 'request_id': 'req-52f57db9-9daf-420d-af8c-3f28329a61cf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:44.828981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e187e3b7894b4cb09a3807bdbea145fc', 'request_id': 'req-52f57db9-9daf-420d-af8c-3f28329a61cf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:44.863176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] The token cache is being invalidate because project e187e3b7894b4cb09a3807bdbea145fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:44.863865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:44.867605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:44.873225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 894/1783] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:44 2022] DELETE /identity/v3/projects/e187e3b7894b4cb09a3807bdbea145fc => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:44.880929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791071a-f8e9-498a-adc0-4f2a87538689 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:44.921722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791071a-f8e9-498a-adc0-4f2a87538689 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:45.001389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:45.004177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:45.109363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:45.178950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:45.211567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:45.216231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:45.218198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:45.220955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] PATH_INFO: `/v3/users/25735dbda7524dffa685db6fa2a71b30` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:45.225815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25735dbda7524dffa685db6fa2a71b30)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:45.237877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:45.259689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f57db9-9daf-420d-af8c-3f28329a61cf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:45.276036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:45.276516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:45.276799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:45.277083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] PATH_INFO: `/v3/users/e3b1ecaaee7e4849b62b57e399699155` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:45.280475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b1ecaaee7e4849b62b57e399699155)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:45.282638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:45.371084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25735dbda7524dffa685db6fa2a71b30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.390538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25735dbda7524dffa685db6fa2a71b30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.392224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25735dbda7524dffa685db6fa2a71b30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.442068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25735dbda7524dffa685db6fa2a71b30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.454046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8cb29cfd-76d9-4e74-8ca6-3e16bc9255c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25735dbda7524dffa685db6fa2a71b30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.466379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 890/1784] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:44 2022] DELETE /identity/v3/users/25735dbda7524dffa685db6fa2a71b30 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:45.490394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b1ecaaee7e4849b62b57e399699155'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.554134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b1ecaaee7e4849b62b57e399699155'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.574592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b1ecaaee7e4849b62b57e399699155'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.592224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b1ecaaee7e4849b62b57e399699155'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.593572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b1ecaaee7e4849b62b57e399699155'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:45.616928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 895/1785] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:45 2022] DELETE /identity/v3/users/e3b1ecaaee7e4849b62b57e399699155 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:45.621911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bffa4-d797-4e65-ab0f-ff2b8eed10a0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:45.623027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bffa4-d797-4e65-ab0f-ff2b8eed10a0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:45.623760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bffa4-d797-4e65-ab0f-ff2b8eed10a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:45.662714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c49bffa4-d797-4e65-ab0f-ff2b8eed10a0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:45.665179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c49bffa4-d797-4e65-ab0f-ff2b8eed10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:45.915990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 891/1786] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:45.945442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:45.947511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:46.170434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3fc83-fbac-4e58-a942-24e1ae6c0130 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:46.191940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92e290-9ed8-4e8b-b6cd-6403fd1cbbbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:46.192904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92e290-9ed8-4e8b-b6cd-6403fd1cbbbd service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:46.197966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92e290-9ed8-4e8b-b6cd-6403fd1cbbbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:46.198312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92e290-9ed8-4e8b-b6cd-6403fd1cbbbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:46.236125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92e290-9ed8-4e8b-b6cd-6403fd1cbbbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:46.243010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92e290-9ed8-4e8b-b6cd-6403fd1cbbbd service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:46.286338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 896/1787] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:47.472510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bffa4-d797-4e65-ab0f-ff2b8eed10a0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:47.474265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c49bffa4-d797-4e65-ab0f-ff2b8eed10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:47.497412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bffa4-d797-4e65-ab0f-ff2b8eed10a0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:47.516437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:47.517242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:47.517615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:47.518602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] PATH_INFO: `/v3/projects/7116f9b411bb4217b662ab034881a24a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:47.519931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7116f9b411bb4217b662ab034881a24a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:47.522002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:47.633169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7116f9b411bb4217b662ab034881a24a', 'request_id': 'req-2fb95d04-db40-4cba-9a50-1d22312d7dad'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:47.645535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7116f9b411bb4217b662ab034881a24a', 'request_id': 'req-2fb95d04-db40-4cba-9a50-1d22312d7dad'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:47.650371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:47.660775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7116f9b411bb4217b662ab034881a24a', 'request_id': 'req-2fb95d04-db40-4cba-9a50-1d22312d7dad'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:47.698049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] The token cache is being invalidate because project 7116f9b411bb4217b662ab034881a24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:47.698636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:47.699601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2fb95d04-db40-4cba-9a50-1d22312d7dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:47.704943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 892/1788] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:47 2022] DELETE /identity/v3/projects/7116f9b411bb4217b662ab034881a24a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:47.707294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51f54-e296-425e-984c-88f8a3cc36c8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:47.707801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51f54-e296-425e-984c-88f8a3cc36c8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:47.707885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51f54-e296-425e-984c-88f8a3cc36c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:47.834857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-38f51f54-e296-425e-984c-88f8a3cc36c8 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:47.837956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-38f51f54-e296-425e-984c-88f8a3cc36c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:47.956945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40abcb0-7c3b-4b1a-850c-046879258631 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:47.958803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40abcb0-7c3b-4b1a-850c-046879258631 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:47.959298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40abcb0-7c3b-4b1a-850c-046879258631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:48.016047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c40abcb0-7c3b-4b1a-850c-046879258631 None None] MFA Rules not processed for user `e0f654bfe8364490a322b88433dd8fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:48.018626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:48.019862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c40abcb0-7c3b-4b1a-850c-046879258631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:48.043893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 897/1789] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:48.049430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e80df8-558b-4f3e-b1d9-35ce689c1ecd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:48.050015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e80df8-558b-4f3e-b1d9-35ce689c1ecd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:48.050529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e80df8-558b-4f3e-b1d9-35ce689c1ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:48.139719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b1e80df8-558b-4f3e-b1d9-35ce689c1ecd None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:48.144041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b1e80df8-558b-4f3e-b1d9-35ce689c1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:48.185765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 898/1790] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:48.186986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e80df8-558b-4f3e-b1d9-35ce689c1ecd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:48.221414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e80df8-558b-4f3e-b1d9-35ce689c1ecd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:48.244979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b29f8-79e2-4f76-b583-9aca67c24cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:48.245741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b29f8-79e2-4f76-b583-9aca67c24cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:48.246003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b29f8-79e2-4f76-b583-9aca67c24cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:48.246347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b29f8-79e2-4f76-b583-9aca67c24cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:48.247074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b29f8-79e2-4f76-b583-9aca67c24cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:48.247369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b29f8-79e2-4f76-b583-9aca67c24cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:48.249233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b29f8-79e2-4f76-b583-9aca67c24cd5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:48.299126 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 893/1791] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Aug 31 11:34:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:48.305225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40abcb0-7c3b-4b1a-850c-046879258631 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:48.314531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 899/1792] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:34:48.319875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b29f8-79e2-4f76-b583-9aca67c24cd5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:48.332112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c40abcb0-7c3b-4b1a-850c-046879258631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:48.382784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b29f8-79e2-4f76-b583-9aca67c24cd5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:48.413785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa6fd9-6715-4868-a71d-cf202e984f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:48.414662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6fd9-6715-4868-a71d-cf202e984f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:48.415319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6fd9-6715-4868-a71d-cf202e984f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:48.415812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6fd9-6715-4868-a71d-cf202e984f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:48.417241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa6fd9-6715-4868-a71d-cf202e984f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:48.431078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40abcb0-7c3b-4b1a-850c-046879258631 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:48.433846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa6fd9-6715-4868-a71d-cf202e984f25 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:48.444940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:48.448138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:48.450196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:48.452610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] PATH_INFO: `/v3/projects/a31d4dac1f3541b29cbc4f1244dd411e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:48.454620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31d4dac1f3541b29cbc4f1244dd411e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:48.460075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:48.572340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 900/1793] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:48 2022] POST /identity/v3/projects => generated 379 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:48.573415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa6fd9-6715-4868-a71d-cf202e984f25 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:48.579638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-59aa6fd9-6715-4868-a71d-cf202e984f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:48.595891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31d4dac1f3541b29cbc4f1244dd411e', 'request_id': 'req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:48.616280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31d4dac1f3541b29cbc4f1244dd411e', 'request_id': 'req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:48.644503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31d4dac1f3541b29cbc4f1244dd411e', 'request_id': 'req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:48.681937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] The token cache is being invalidate because project a31d4dac1f3541b29cbc4f1244dd411e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:48.682294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:48.683434 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d501912a-5212-49f9-ab1e-ea9fa1ec7c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:48.688935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 894/1794] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:48 2022] DELETE /identity/v3/projects/a31d4dac1f3541b29cbc4f1244dd411e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:48.694822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effe2c2-b979-4184-bfca-4158f75a1665 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:48.695201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effe2c2-b979-4184-bfca-4158f75a1665 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:48.695488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effe2c2-b979-4184-bfca-4158f75a1665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:48.728754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa6fd9-6715-4868-a71d-cf202e984f25 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:48.747305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3effe2c2-b979-4184-bfca-4158f75a1665 None None] MFA Rules not processed for user `09e1a58dc35c49d4b5cccd6d91b9ef47`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:48.747758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:48.748670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:48.748873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3effe2c2-b979-4184-bfca-4158f75a1665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:48.749519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:48.751006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:48.756916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:48.791584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:48.793870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:48.804957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 901/1795] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:48.806182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:48.808016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:48.902308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdc9f8-f03a-44a0-859b-1957622d6724 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:48.909511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:48.910501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:48.911025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:48.911523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] PATH_INFO: `/v3/users/2181013f826e4083a7d43b442102809f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:48.913061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2181013f826e4083a7d43b442102809f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:48.915343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:49.014415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2181013f826e4083a7d43b442102809f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.014876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 895/1796] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:49.015544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effe2c2-b979-4184-bfca-4158f75a1665 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:49.021269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3effe2c2-b979-4184-bfca-4158f75a1665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.069666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:49.070104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effe2c2-b979-4184-bfca-4158f75a1665 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:49.074916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2181013f826e4083a7d43b442102809f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.076923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac36dc-b9b4-4afe-a5d0-749bc49fdeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:49.077894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac36dc-b9b4-4afe-a5d0-749bc49fdeef admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:49.078240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac36dc-b9b4-4afe-a5d0-749bc49fdeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:49.078879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac36dc-b9b4-4afe-a5d0-749bc49fdeef admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:49.079648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac36dc-b9b4-4afe-a5d0-749bc49fdeef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:49.082672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac36dc-b9b4-4afe-a5d0-749bc49fdeef admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:49.105522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2181013f826e4083a7d43b442102809f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.118750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2181013f826e4083a7d43b442102809f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.119951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2181013f826e4083a7d43b442102809f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.130783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 902/1797] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:48 2022] DELETE /identity/v3/users/2181013f826e4083a7d43b442102809f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:49.132573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:49.134890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.160135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 896/1798] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:49 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:49.170919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1dea0-760a-4c5e-a610-fc8fc67b32a0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:49.171980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1dea0-760a-4c5e-a610-fc8fc67b32a0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:49.172571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1dea0-760a-4c5e-a610-fc8fc67b32a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:49.217203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:49.242405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6bf1dea0-760a-4c5e-a610-fc8fc67b32a0 None None] MFA Rules not processed for user `a7c9275aeee8438fa1fde55f207fd730`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:49.244091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6bf1dea0-760a-4c5e-a610-fc8fc67b32a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.258830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6270d-d6d7-4719-a485-3d48883cafd3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:49.269240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:49.269885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:49.270166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:49.270815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:49.273641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.288190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:49.290414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:49.303779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 903/1799] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:49.304975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:49.307159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.414710 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 897/1800] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:49.416196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f7e59-a5f9-4718-aa26-b55ecae4deb0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:49.416588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f7e59-a5f9-4718-aa26-b55ecae4deb0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:49.417013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f7e59-a5f9-4718-aa26-b55ecae4deb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:49.472627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f248197-b801-439b-9b93-efdada56686e service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:49.474038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d96f7e59-a5f9-4718-aa26-b55ecae4deb0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:49.485827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:49.486874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:49.487182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:49.487561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] PATH_INFO: `/v3/users/3c0f14fd498041558b55835688aecb2e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:49.491558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0f14fd498041558b55835688aecb2e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:49.501221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:49.504896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d96f7e59-a5f9-4718-aa26-b55ecae4deb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.545486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 898/1801] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:49.550893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f7e59-a5f9-4718-aa26-b55ecae4deb0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:49.555433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d96f7e59-a5f9-4718-aa26-b55ecae4deb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.601209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f7e59-a5f9-4718-aa26-b55ecae4deb0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:49.608547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c9ff-4622-40da-a452-213341ae4cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:49.609622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c9ff-4622-40da-a452-213341ae4cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:49.610407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c9ff-4622-40da-a452-213341ae4cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:49.611142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c9ff-4622-40da-a452-213341ae4cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:49.619281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924c9ff-4622-40da-a452-213341ae4cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:49.620357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0f14fd498041558b55835688aecb2e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.629857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924c9ff-4622-40da-a452-213341ae4cd3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:49.659545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 899/1802] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:49.660490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0f14fd498041558b55835688aecb2e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.662570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c9ff-4622-40da-a452-213341ae4cd3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:49.677675 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4924c9ff-4622-40da-a452-213341ae4cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.679223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0f14fd498041558b55835688aecb2e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.700503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0f14fd498041558b55835688aecb2e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.701659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0f14fd498041558b55835688aecb2e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:49.704800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:49.712337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 904/1803] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:49 2022] DELETE /identity/v3/users/3c0f14fd498041558b55835688aecb2e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:49.713297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:49.715161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.717313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c9ff-4622-40da-a452-213341ae4cd3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:49.815664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e90ad-2fa9-4334-9e76-efbfd56db632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:49.816465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e90ad-2fa9-4334-9e76-efbfd56db632 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:49.817653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e90ad-2fa9-4334-9e76-efbfd56db632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:49.818011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e90ad-2fa9-4334-9e76-efbfd56db632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:49.821393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-922e90ad-2fa9-4334-9e76-efbfd56db632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:49.859847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ac711-b7e6-4321-b3ca-d309e97ee662 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:49.866972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326a4fe-2abe-4e17-ab42-6cc22770923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:49.869749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326a4fe-2abe-4e17-ab42-6cc22770923a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:49.870324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326a4fe-2abe-4e17-ab42-6cc22770923a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:49.870850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326a4fe-2abe-4e17-ab42-6cc22770923a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:49.871891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326a4fe-2abe-4e17-ab42-6cc22770923a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:49.875089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326a4fe-2abe-4e17-ab42-6cc22770923a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:49.896552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 905/1804] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:49.900745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326a4fe-2abe-4e17-ab42-6cc22770923a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:49.917803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326a4fe-2abe-4e17-ab42-6cc22770923a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:49.930117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284a0f5-c1e6-495c-a61d-c5540339647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:49.933012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284a0f5-c1e6-495c-a61d-c5540339647b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:49.934870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284a0f5-c1e6-495c-a61d-c5540339647b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:49.935380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284a0f5-c1e6-495c-a61d-c5540339647b admin admin] PATH_INFO: `/v3/projects/bad84738a69a406aaae89c94c08e206d/users/3ecc25b305c74f9ca423999d0e863964/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:49.983211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e90ad-2fa9-4334-9e76-efbfd56db632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:49.989031 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e90ad-2fa9-4334-9e76-efbfd56db632 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:50.012073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284a0f5-c1e6-495c-a61d-c5540339647b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad84738a69a406aaae89c94c08e206d, user_id=3ecc25b305c74f9ca423999d0e863964, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:50.015984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 900/1805] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:50.016289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284a0f5-c1e6-495c-a61d-c5540339647b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:50.067164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 906/1806] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:49 2022] PUT /identity/v3/projects/bad84738a69a406aaae89c94c08e206d/users/3ecc25b305c74f9ca423999d0e863964/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:34:50.081256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094eb3-d2e5-453d-a03f-09065e1545e7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:50.081608 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094eb3-d2e5-453d-a03f-09065e1545e7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:50.081895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094eb3-d2e5-453d-a03f-09065e1545e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:50.172453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-04094eb3-d2e5-453d-a03f-09065e1545e7 None None] MFA Rules not processed for user `3ecc25b305c74f9ca423999d0e863964`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:50.173906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-04094eb3-d2e5-453d-a03f-09065e1545e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:50.396866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:50.481740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 901/1807] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:50.488356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284a0f5-c1e6-495c-a61d-c5540339647b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:50.662280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284a0f5-c1e6-495c-a61d-c5540339647b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:50.684860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b896f4-4d1e-4196-92b3-915b5c90fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:50.686794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b896f4-4d1e-4196-92b3-915b5c90fda8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:50.689386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b896f4-4d1e-4196-92b3-915b5c90fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:50.689767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b896f4-4d1e-4196-92b3-915b5c90fda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:50.694907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b896f4-4d1e-4196-92b3-915b5c90fda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:50.701336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b896f4-4d1e-4196-92b3-915b5c90fda8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:50.805475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 907/1808] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:50 2022] POST /identity/v3/projects => generated 379 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:50.809708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04094eb3-d2e5-453d-a03f-09065e1545e7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:50.830771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04094eb3-d2e5-453d-a03f-09065e1545e7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:51.097502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844b8e1-baab-4ddb-8979-c64891dfebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:51.098298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844b8e1-baab-4ddb-8979-c64891dfebd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:51.098674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844b8e1-baab-4ddb-8979-c64891dfebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:51.099062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844b8e1-baab-4ddb-8979-c64891dfebd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:51.099810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844b8e1-baab-4ddb-8979-c64891dfebd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:51.104587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844b8e1-baab-4ddb-8979-c64891dfebd3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:51.151129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 902/1809] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:50 2022] POST /identity/v3/users => generated 296 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:51.156107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b896f4-4d1e-4196-92b3-915b5c90fda8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:51.177721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b896f4-4d1e-4196-92b3-915b5c90fda8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:51.198798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d05d6-f3ef-4e21-aaf3-9934c15ea066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:51.207478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d05d6-f3ef-4e21-aaf3-9934c15ea066 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:51.207863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d05d6-f3ef-4e21-aaf3-9934c15ea066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:51.208198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d05d6-f3ef-4e21-aaf3-9934c15ea066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:51.209083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d05d6-f3ef-4e21-aaf3-9934c15ea066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:51.210633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d05d6-f3ef-4e21-aaf3-9934c15ea066 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:51.263456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844b8e1-baab-4ddb-8979-c64891dfebd3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:51.267490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 908/1810] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:51.280801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844b8e1-baab-4ddb-8979-c64891dfebd3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:51.295379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d79b9-1382-4fbe-bc22-c034b68023c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:51.297604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d79b9-1382-4fbe-bc22-c034b68023c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:51.299092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d79b9-1382-4fbe-bc22-c034b68023c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:51.299512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d79b9-1382-4fbe-bc22-c034b68023c4 admin admin] PATH_INFO: `/v3/projects/102cfc33ae504749929e17c7407a0dee/users/b9b5b98a45cc49729537bdf3ee39dd30/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:51.343337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d79b9-1382-4fbe-bc22-c034b68023c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102cfc33ae504749929e17c7407a0dee, user_id=b9b5b98a45cc49729537bdf3ee39dd30, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:51.348539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d79b9-1382-4fbe-bc22-c034b68023c4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:51.382545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 903/1811] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:51 2022] PUT /identity/v3/projects/102cfc33ae504749929e17c7407a0dee/users/b9b5b98a45cc49729537bdf3ee39dd30/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:51.386867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d05d6-f3ef-4e21-aaf3-9934c15ea066 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:51.406785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d05d6-f3ef-4e21-aaf3-9934c15ea066 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:51.548744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:51.579043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d79d50-9296-4671-a9f7-613bf938fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:51.579991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d79d50-9296-4671-a9f7-613bf938fb86 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:51.580960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d79d50-9296-4671-a9f7-613bf938fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:51.582089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d79d50-9296-4671-a9f7-613bf938fb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:51.583101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d79d50-9296-4671-a9f7-613bf938fb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:51.584927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d79d50-9296-4671-a9f7-613bf938fb86 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:51.625814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 909/1812] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:51.632138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d79b9-1382-4fbe-bc22-c034b68023c4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:51.646830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d79b9-1382-4fbe-bc22-c034b68023c4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:51.657419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7eef0-9ede-4981-8471-fb72a5e8315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:51.658232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7eef0-9ede-4981-8471-fb72a5e8315a admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:51.658650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7eef0-9ede-4981-8471-fb72a5e8315a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:51.659049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7eef0-9ede-4981-8471-fb72a5e8315a admin admin] PATH_INFO: `/v3/projects/102cfc33ae504749929e17c7407a0dee/users/b9b5b98a45cc49729537bdf3ee39dd30/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:51.664475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7eef0-9ede-4981-8471-fb72a5e8315a admin admin] RBAC: Authorizing `identity:create_grant(project_id=102cfc33ae504749929e17c7407a0dee, user_id=b9b5b98a45cc49729537bdf3ee39dd30, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:51.670145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7eef0-9ede-4981-8471-fb72a5e8315a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:51.699285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 904/1813] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:51 2022] PUT /identity/v3/projects/102cfc33ae504749929e17c7407a0dee/users/b9b5b98a45cc49729537bdf3ee39dd30/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:51.711792 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a56f-c5d7-433e-a698-b96f1414358b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:51.712333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a56f-c5d7-433e-a698-b96f1414358b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:51.712760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a56f-c5d7-433e-a698-b96f1414358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:51.796524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8879a56f-c5d7-433e-a698-b96f1414358b None None] MFA Rules not processed for user `b9b5b98a45cc49729537bdf3ee39dd30`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:51.798630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8879a56f-c5d7-433e-a698-b96f1414358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:51.982334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 910/1814] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:52.008446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7eef0-9ede-4981-8471-fb72a5e8315a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:52.012988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-13e7eef0-9ede-4981-8471-fb72a5e8315a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:52.152909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7eef0-9ede-4981-8471-fb72a5e8315a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:52.170497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896b6f6-51c3-482a-ada3-7a489e436ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:52.171280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896b6f6-51c3-482a-ada3-7a489e436ced service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:52.171662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896b6f6-51c3-482a-ada3-7a489e436ced service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:52.171939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896b6f6-51c3-482a-ada3-7a489e436ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:52.204144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896b6f6-51c3-482a-ada3-7a489e436ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:52.206337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896b6f6-51c3-482a-ada3-7a489e436ced service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:52.243219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 905/1815] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:52.427993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879a56f-c5d7-433e-a698-b96f1414358b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:52.446081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879a56f-c5d7-433e-a698-b96f1414358b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:52.464182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18df48-1838-49b3-9989-0afcb07cd093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:52.465167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18df48-1838-49b3-9989-0afcb07cd093 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:52.465656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18df48-1838-49b3-9989-0afcb07cd093 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:52.466160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18df48-1838-49b3-9989-0afcb07cd093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:52.730812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18df48-1838-49b3-9989-0afcb07cd093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:52.752051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18df48-1838-49b3-9989-0afcb07cd093 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:52.788984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 911/1816] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:53.037022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896b6f6-51c3-482a-ada3-7a489e436ced service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:53.038468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e896b6f6-51c3-482a-ada3-7a489e436ced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:53.125489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:53.217356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896b6f6-51c3-482a-ada3-7a489e436ced service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:53.228487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:53.230096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:53.230676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:53.231388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] PATH_INFO: `/v3/projects/f605a8310be94d859c99ad38b85df3f0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:53.234774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f605a8310be94d859c99ad38b85df3f0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:53.238901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:53.358159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f605a8310be94d859c99ad38b85df3f0', 'request_id': 'req-340c469b-ad17-436d-82d9-14fe3730938e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.367439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f605a8310be94d859c99ad38b85df3f0', 'request_id': 'req-340c469b-ad17-436d-82d9-14fe3730938e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.377589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f605a8310be94d859c99ad38b85df3f0', 'request_id': 'req-340c469b-ad17-436d-82d9-14fe3730938e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.425334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] The token cache is being invalidate because project f605a8310be94d859c99ad38b85df3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:53.426107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.429197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-340c469b-ad17-436d-82d9-14fe3730938e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.435539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18df48-1838-49b3-9989-0afcb07cd093 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:53.444627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 906/1817] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:53 2022] DELETE /identity/v3/projects/f605a8310be94d859c99ad38b85df3f0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:34:53.457522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86970e-5c0b-4aef-b7b0-703f6b296263 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:53.458094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86970e-5c0b-4aef-b7b0-703f6b296263 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:53.458441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86970e-5c0b-4aef-b7b0-703f6b296263 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:53.460010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 907/1818] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:34:53.460482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18df48-1838-49b3-9989-0afcb07cd093 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:53.517752 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25cfb3-b4b6-43cc-bbf1-70b4cea2abed None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:53.518840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25cfb3-b4b6-43cc-bbf1-70b4cea2abed None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:53.519488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25cfb3-b4b6-43cc-bbf1-70b4cea2abed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:53.588177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cc25cfb3-b4b6-43cc-bbf1-70b4cea2abed None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:53.593423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cc25cfb3-b4b6-43cc-bbf1-70b4cea2abed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:53.675520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:53.676187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:53.676467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:53.676741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] PATH_INFO: `/v3/users/650b58de092447ba9b2a5cfe179a8700` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:53.680413 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650b58de092447ba9b2a5cfe179a8700)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:53.682400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:53.716159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:53.791412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650b58de092447ba9b2a5cfe179a8700'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.807965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650b58de092447ba9b2a5cfe179a8700'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.816315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650b58de092447ba9b2a5cfe179a8700'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.824444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 908/1819] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:34:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:53.826488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650b58de092447ba9b2a5cfe179a8700'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.827666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b8b86eb7-1e7b-4e0d-8ab5-6c6c4ba3a274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650b58de092447ba9b2a5cfe179a8700'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:53.851850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 912/1820] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:53 2022] DELETE /identity/v3/users/650b58de092447ba9b2a5cfe179a8700 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:34:54.109325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25cfb3-b4b6-43cc-bbf1-70b4cea2abed None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:54.113449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cc25cfb3-b4b6-43cc-bbf1-70b4cea2abed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:54.145996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25cfb3-b4b6-43cc-bbf1-70b4cea2abed None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:54.255730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebe07b-fb28-4ede-8a62-d967e3e534d5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:54.256057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebe07b-fb28-4ede-8a62-d967e3e534d5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:54.256314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebe07b-fb28-4ede-8a62-d967e3e534d5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:54.258019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 913/1821] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:34:54.326901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e8bf-c2dc-456d-b60e-45224dd0b574 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:54.327180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e8bf-c2dc-456d-b60e-45224dd0b574 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:54.327469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e8bf-c2dc-456d-b60e-45224dd0b574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:54.375444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:54.393627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8f84e8bf-c2dc-456d-b60e-45224dd0b574 None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:54.394265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8f84e8bf-c2dc-456d-b60e-45224dd0b574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:54.432924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:54.437296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:54.438431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:54.438746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] PATH_INFO: `/v3/projects/80022d4d53bf425ea686f2ebb1823fd6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:54.445714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=80022d4d53bf425ea686f2ebb1823fd6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:54.447722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:54.583613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 914/1822] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:34:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:54.635181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80022d4d53bf425ea686f2ebb1823fd6', 'request_id': 'req-924dc4d6-857f-445a-982b-c2eb84ce6bcb'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:54.648396 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80022d4d53bf425ea686f2ebb1823fd6', 'request_id': 'req-924dc4d6-857f-445a-982b-c2eb84ce6bcb'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:54.668224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80022d4d53bf425ea686f2ebb1823fd6', 'request_id': 'req-924dc4d6-857f-445a-982b-c2eb84ce6bcb'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:54.718012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] The token cache is being invalidate because project 80022d4d53bf425ea686f2ebb1823fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:54.718308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:54.719376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:54.725085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 909/1823] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:54 2022] DELETE /identity/v3/projects/80022d4d53bf425ea686f2ebb1823fd6 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:54.727527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:54.728632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a4c6-24db-49ed-b2f9-e653a8a7c1cb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:54.729136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a4c6-24db-49ed-b2f9-e653a8a7c1cb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:54.729668 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a4c6-24db-49ed-b2f9-e653a8a7c1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:54.730474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:54.776137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7186a4c6-24db-49ed-b2f9-e653a8a7c1cb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:54.777477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7186a4c6-24db-49ed-b2f9-e653a8a7c1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:55.064139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 915/1824] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:55.079103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96d501-8701-4e53-b3e3-921d51d7d2b0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:55.082203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96d501-8701-4e53-b3e3-921d51d7d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:55.085618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96d501-8701-4e53-b3e3-921d51d7d2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:55.224823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dc4d6-857f-445a-982b-c2eb84ce6bcb admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:55.246144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fb96d501-8701-4e53-b3e3-921d51d7d2b0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:55.246144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fb96d501-8701-4e53-b3e3-921d51d7d2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:55.291154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe07531-6466-4465-b4a1-b823b7112428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:55.292237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe07531-6466-4465-b4a1-b823b7112428 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:55.292733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe07531-6466-4465-b4a1-b823b7112428 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:55.295116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 916/1825] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:55.299569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96d501-8701-4e53-b3e3-921d51d7d2b0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:55.302205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fb96d501-8701-4e53-b3e3-921d51d7d2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:55.304832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe07531-6466-4465-b4a1-b823b7112428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:55.320691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bbe07531-6466-4465-b4a1-b823b7112428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:55.334567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96d501-8701-4e53-b3e3-921d51d7d2b0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:55.349599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:55.350847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:55.351354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:55.352584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] PATH_INFO: `/v3/projects/d9fd70aefab74231b2573601988bbff9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:55.355125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fd70aefab74231b2573601988bbff9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:55.362911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:55.379414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:55.421499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe07531-6466-4465-b4a1-b823b7112428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:55.423502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe07531-6466-4465-b4a1-b823b7112428 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:55.458380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 910/1826] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:55.459297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe07531-6466-4465-b4a1-b823b7112428 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:55.489478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe07531-6466-4465-b4a1-b823b7112428 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:55.506122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fd70aefab74231b2573601988bbff9', 'request_id': 'req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:55.537385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fd70aefab74231b2573601988bbff9', 'request_id': 'req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:55.570230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fd70aefab74231b2573601988bbff9', 'request_id': 'req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:55.617694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:55.620195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:55.620939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] The token cache is being invalidate because project d9fd70aefab74231b2573601988bbff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:55.621723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:55.622149 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:55.622702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:55.623535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:55.624876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:55.625089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8cfafee6-d8cc-48ff-9833-0b57d6dc92d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:55.629631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 917/1827] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:55 2022] DELETE /identity/v3/projects/d9fd70aefab74231b2573601988bbff9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:55.630700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:55.634937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aede194-3357-47f8-87b1-09e885cbeed9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:55.635438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aede194-3357-47f8-87b1-09e885cbeed9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:55.635943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aede194-3357-47f8-87b1-09e885cbeed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:55.658178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:55.671918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 911/1828] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:55.673016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:55.676647 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:55.689637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1aede194-3357-47f8-87b1-09e885cbeed9 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:55.703388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1aede194-3357-47f8-87b1-09e885cbeed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:55.703597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc7c0b-94bb-410e-a28d-4a5d662d67f3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:55.714534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 918/1829] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:55.716879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ded5f-c0c0-48df-b8cc-524d4a7d9692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:55.717535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ded5f-c0c0-48df-b8cc-524d4a7d9692 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:55.717871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ded5f-c0c0-48df-b8cc-524d4a7d9692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:55.718248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ded5f-c0c0-48df-b8cc-524d4a7d9692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:55.730316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89d336-e8c3-458a-91bb-fa40885f8957 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:55.730674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89d336-e8c3-458a-91bb-fa40885f8957 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:55.730978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89d336-e8c3-458a-91bb-fa40885f8957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:55.734014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ded5f-c0c0-48df-b8cc-524d4a7d9692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:55.736135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ded5f-c0c0-48df-b8cc-524d4a7d9692 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:55.792131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0a89d336-e8c3-458a-91bb-fa40885f8957 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:55.793732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0a89d336-e8c3-458a-91bb-fa40885f8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:55.829159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 919/1830] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:55.830666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89d336-e8c3-458a-91bb-fa40885f8957 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:55.834653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 912/1831] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:55 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:55.834653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ded5f-c0c0-48df-b8cc-524d4a7d9692 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:55.836343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0a89d336-e8c3-458a-91bb-fa40885f8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:56.020839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ded5f-c0c0-48df-b8cc-524d4a7d9692 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.027426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdd3ff-3720-43e0-967d-90e58b287ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.027698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdd3ff-3720-43e0-967d-90e58b287ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.028132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdd3ff-3720-43e0-967d-90e58b287ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.028502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdd3ff-3720-43e0-967d-90e58b287ad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.030269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdd3ff-3720-43e0-967d-90e58b287ad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:34:56.030722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdd3ff-3720-43e0-967d-90e58b287ad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.032703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdd3ff-3720-43e0-967d-90e58b287ad9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.039525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89d336-e8c3-458a-91bb-fa40885f8957 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.088092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 913/1832] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:34:56.089661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdd3ff-3720-43e0-967d-90e58b287ad9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:56.123979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdd3ff-3720-43e0-967d-90e58b287ad9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.136317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce2be-ffbb-4a61-be68-4e3d74df5ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.137310 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce2be-ffbb-4a61-be68-4e3d74df5ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.137771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce2be-ffbb-4a61-be68-4e3d74df5ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.139487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce2be-ffbb-4a61-be68-4e3d74df5ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.140303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ce2be-ffbb-4a61-be68-4e3d74df5ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.146400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ce2be-ffbb-4a61-be68-4e3d74df5ee5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.208840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 914/1833] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:56 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:56.210634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce2be-ffbb-4a61-be68-4e3d74df5ee5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:56.223978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce2be-ffbb-4a61-be68-4e3d74df5ee5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.230006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679f85-596b-412d-bccc-5d81ab67501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.230646 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679f85-596b-412d-bccc-5d81ab67501d admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.231159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679f85-596b-412d-bccc-5d81ab67501d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.231524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679f85-596b-412d-bccc-5d81ab67501d admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.232316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7679f85-596b-412d-bccc-5d81ab67501d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.234618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7679f85-596b-412d-bccc-5d81ab67501d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.260816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a094432-6ac5-486c-9751-d83c0a69389e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.262477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a094432-6ac5-486c-9751-d83c0a69389e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.263449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a094432-6ac5-486c-9751-d83c0a69389e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.264536 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a094432-6ac5-486c-9751-d83c0a69389e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.267954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4a094432-6ac5-486c-9751-d83c0a69389e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:56.288714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a094432-6ac5-486c-9751-d83c0a69389e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.290582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a094432-6ac5-486c-9751-d83c0a69389e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.313150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 920/1834] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:56.314008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 915/1835] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:56 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:56.314244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a094432-6ac5-486c-9751-d83c0a69389e service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:56.318397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679f85-596b-412d-bccc-5d81ab67501d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:56.324249 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:56.334036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a094432-6ac5-486c-9751-d83c0a69389e service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.476291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679f85-596b-412d-bccc-5d81ab67501d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.477715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ed00-2189-49bc-ace1-4b59635ce56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.478488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ed00-2189-49bc-ace1-4b59635ce56b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.478888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ed00-2189-49bc-ace1-4b59635ce56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.479170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ed00-2189-49bc-ace1-4b59635ce56b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.479879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065ed00-2189-49bc-ace1-4b59635ce56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.481520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065ed00-2189-49bc-ace1-4b59635ce56b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.489330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef59c5-cb05-436a-b9d1-2bdf6f6ac4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.489991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef59c5-cb05-436a-b9d1-2bdf6f6ac4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.490225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef59c5-cb05-436a-b9d1-2bdf6f6ac4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.490498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef59c5-cb05-436a-b9d1-2bdf6f6ac4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.491183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef59c5-cb05-436a-b9d1-2bdf6f6ac4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.493130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef59c5-cb05-436a-b9d1-2bdf6f6ac4f9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.514727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 921/1836] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:56.520284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ed00-2189-49bc-ace1-4b59635ce56b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:56.536694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 916/1837] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:56 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:34:56.541348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef59c5-cb05-436a-b9d1-2bdf6f6ac4f9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:56.548153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ed00-2189-49bc-ace1-4b59635ce56b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.562584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef59c5-cb05-436a-b9d1-2bdf6f6ac4f9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.569003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b301d1-0062-4a47-8625-940b3050235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.570027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b301d1-0062-4a47-8625-940b3050235d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.572902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b301d1-0062-4a47-8625-940b3050235d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.573695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b301d1-0062-4a47-8625-940b3050235d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.574840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1653b55-8dcd-4670-8a3b-e408324382fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.575476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1653b55-8dcd-4670-8a3b-e408324382fa admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.575826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b301d1-0062-4a47-8625-940b3050235d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.576466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1653b55-8dcd-4670-8a3b-e408324382fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.576764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1653b55-8dcd-4670-8a3b-e408324382fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.577426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1653b55-8dcd-4670-8a3b-e408324382fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.579085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1653b55-8dcd-4670-8a3b-e408324382fa admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.580773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b301d1-0062-4a47-8625-940b3050235d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.606250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 917/1838] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:56.607340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1653b55-8dcd-4670-8a3b-e408324382fa admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:56.607466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 922/1839] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:56.614910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b301d1-0062-4a47-8625-940b3050235d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:56.635479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1653b55-8dcd-4670-8a3b-e408324382fa admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.646092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b301d1-0062-4a47-8625-940b3050235d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.650073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5cb2e-284e-434b-a582-c52d92171b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.650768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5cb2e-284e-434b-a582-c52d92171b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.651001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5cb2e-284e-434b-a582-c52d92171b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.651394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5cb2e-284e-434b-a582-c52d92171b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.651927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5cb2e-284e-434b-a582-c52d92171b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.653556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5cb2e-284e-434b-a582-c52d92171b7c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.664313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:56.681463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a1da8-7b43-496c-aa64-8d4c23b6c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.682427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1da8-7b43-496c-aa64-8d4c23b6c880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.682887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1da8-7b43-496c-aa64-8d4c23b6c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.683817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 918/1840] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:56.688457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5cb2e-284e-434b-a582-c52d92171b7c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:56.691096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1da8-7b43-496c-aa64-8d4c23b6c880 admin admin] PATH_INFO: `/v3/projects/c3c554f612d34f859d4ebd779f141e37/users/4af7a03823a04a8ca0676ff3697b4af2/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.742209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5cb2e-284e-434b-a582-c52d92171b7c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:56.744576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a1da8-7b43-496c-aa64-8d4c23b6c880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c554f612d34f859d4ebd779f141e37, user_id=4af7a03823a04a8ca0676ff3697b4af2, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.755789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a1da8-7b43-496c-aa64-8d4c23b6c880 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.758130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910a8d-7a31-478f-9f47-be09cf6c46c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:56.758847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910a8d-7a31-478f-9f47-be09cf6c46c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.759149 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910a8d-7a31-478f-9f47-be09cf6c46c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.759403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910a8d-7a31-478f-9f47-be09cf6c46c3 admin admin] PATH_INFO: `/v3/projects/9c04f453692b4b8cbf2967af4d7cc8c7/users/93dbfac46c6845b79d7db1a6046213cc/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.811137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 923/1841] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:56 2022] PUT /identity/v3/projects/c3c554f612d34f859d4ebd779f141e37/users/4af7a03823a04a8ca0676ff3697b4af2/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:56.811340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b910a8d-7a31-478f-9f47-be09cf6c46c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c04f453692b4b8cbf2967af4d7cc8c7, user_id=93dbfac46c6845b79d7db1a6046213cc, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:56.815863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e98fa5-e875-4f7f-a9ea-69ad174de3a3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.816781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e98fa5-e875-4f7f-a9ea-69ad174de3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.817332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e98fa5-e875-4f7f-a9ea-69ad174de3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.826591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b910a8d-7a31-478f-9f47-be09cf6c46c3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:56.887576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 919/1842] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:56 2022] PUT /identity/v3/projects/9c04f453692b4b8cbf2967af4d7cc8c7/users/93dbfac46c6845b79d7db1a6046213cc/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:56.900062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee69bf3-bde6-4d14-b630-421436e15e6d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:56.905416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee69bf3-bde6-4d14-b630-421436e15e6d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:56.905882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee69bf3-bde6-4d14-b630-421436e15e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:56.919299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e8e98fa5-e875-4f7f-a9ea-69ad174de3a3 None None] MFA Rules not processed for user `4af7a03823a04a8ca0676ff3697b4af2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:56.920973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e8e98fa5-e875-4f7f-a9ea-69ad174de3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:57.027756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4ee69bf3-bde6-4d14-b630-421436e15e6d None None] MFA Rules not processed for user `93dbfac46c6845b79d7db1a6046213cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:57.029001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4ee69bf3-bde6-4d14-b630-421436e15e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:57.077769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 924/1843] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:57.085727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e98fa5-e875-4f7f-a9ea-69ad174de3a3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.249840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:57.260542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e98fa5-e875-4f7f-a9ea-69ad174de3a3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.269861 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f8a04-2bc1-4f6e-b331-0d09597d8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.271293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8a04-2bc1-4f6e-b331-0d09597d8f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.271770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8a04-2bc1-4f6e-b331-0d09597d8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.272127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8a04-2bc1-4f6e-b331-0d09597d8f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.272889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f8a04-2bc1-4f6e-b331-0d09597d8f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.275033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f8a04-2bc1-4f6e-b331-0d09597d8f25 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.309833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 920/1844] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:34:57.317440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee69bf3-bde6-4d14-b630-421436e15e6d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.330008 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 925/1845] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:57 2022] POST /identity/v3/projects => generated 389 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:57.334241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f8a04-2bc1-4f6e-b331-0d09597d8f25 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.347969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee69bf3-bde6-4d14-b630-421436e15e6d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.446889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11844213-5956-4bbe-b2a0-dd4fdec6de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.447773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11844213-5956-4bbe-b2a0-dd4fdec6de68 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.448140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11844213-5956-4bbe-b2a0-dd4fdec6de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.448410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11844213-5956-4bbe-b2a0-dd4fdec6de68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.448986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11844213-5956-4bbe-b2a0-dd4fdec6de68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.451024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11844213-5956-4bbe-b2a0-dd4fdec6de68 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.464768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f8a04-2bc1-4f6e-b331-0d09597d8f25 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.472156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7037a-8362-495a-83e2-32ac401be342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.473513 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7037a-8362-495a-83e2-32ac401be342 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.474130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7037a-8362-495a-83e2-32ac401be342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.474993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7037a-8362-495a-83e2-32ac401be342 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.476244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7037a-8362-495a-83e2-32ac401be342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.479349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7037a-8362-495a-83e2-32ac401be342 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.486197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 921/1846] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:34:57 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:34:57.490466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11844213-5956-4bbe-b2a0-dd4fdec6de68 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.514330 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 926/1847] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:57 2022] POST /identity/v3/users => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:57.515808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7037a-8362-495a-83e2-32ac401be342 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.531026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7037a-8362-495a-83e2-32ac401be342 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.585683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:57.601566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11844213-5956-4bbe-b2a0-dd4fdec6de68 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.606048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57036422-f7f4-443b-8c8a-9ecee392562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.606478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea5f42-56a8-4b7e-86b4-6e603077029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.606669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57036422-f7f4-443b-8c8a-9ecee392562d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.606983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57036422-f7f4-443b-8c8a-9ecee392562d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.607143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea5f42-56a8-4b7e-86b4-6e603077029b admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.607252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57036422-f7f4-443b-8c8a-9ecee392562d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.607430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea5f42-56a8-4b7e-86b4-6e603077029b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.607709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea5f42-56a8-4b7e-86b4-6e603077029b admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.607933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57036422-f7f4-443b-8c8a-9ecee392562d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.608379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea5f42-56a8-4b7e-86b4-6e603077029b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.609824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57036422-f7f4-443b-8c8a-9ecee392562d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.610573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea5f42-56a8-4b7e-86b4-6e603077029b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.621166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 927/1848] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:34:57.625077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57036422-f7f4-443b-8c8a-9ecee392562d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.638267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57036422-f7f4-443b-8c8a-9ecee392562d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.643932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b857f-0a30-4bfa-bc20-12ed9e89d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.644656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b857f-0a30-4bfa-bc20-12ed9e89d32c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.644936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b857f-0a30-4bfa-bc20-12ed9e89d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.645211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b857f-0a30-4bfa-bc20-12ed9e89d32c admin admin] PATH_INFO: `/v3/projects/0e63070f2c784309997667bdfdbf7fb8/users/9f034b12bdc14a97ae81fd6ddee5d931/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.650526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 922/1849] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:34:57 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:34:57.651584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea5f42-56a8-4b7e-86b4-6e603077029b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.660706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b857f-0a30-4bfa-bc20-12ed9e89d32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e63070f2c784309997667bdfdbf7fb8, user_id=9f034b12bdc14a97ae81fd6ddee5d931, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.663471 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b857f-0a30-4bfa-bc20-12ed9e89d32c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.671452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea5f42-56a8-4b7e-86b4-6e603077029b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.674281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1af25-b80a-408f-a8d7-064c5596902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.675524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1af25-b80a-408f-a8d7-064c5596902c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.675861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1af25-b80a-408f-a8d7-064c5596902c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.676201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1af25-b80a-408f-a8d7-064c5596902c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.676917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1af25-b80a-408f-a8d7-064c5596902c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.678871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1af25-b80a-408f-a8d7-064c5596902c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.680309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 928/1850] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:57 2022] PUT /identity/v3/projects/0e63070f2c784309997667bdfdbf7fb8/users/9f034b12bdc14a97ae81fd6ddee5d931/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:34:57.683955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b857f-0a30-4bfa-bc20-12ed9e89d32c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.701977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 923/1851] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:34:57.707919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1af25-b80a-408f-a8d7-064c5596902c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.720798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1af25-b80a-408f-a8d7-064c5596902c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.742946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:57.772187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b857f-0a30-4bfa-bc20-12ed9e89d32c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.796052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9105db0-e0c2-41fd-b9ff-4ae609f084b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.796891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9105db0-e0c2-41fd-b9ff-4ae609f084b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.797054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9105db0-e0c2-41fd-b9ff-4ae609f084b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.797287 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9105db0-e0c2-41fd-b9ff-4ae609f084b6 admin admin] PATH_INFO: `/v3/projects/f13214f0d6534d90a5fbe335724ee801/users/bdeec0079ad544769c4c7dfa017f2dd8/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.797584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71c007-d95e-4df1-961b-2360721c5849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.798889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71c007-d95e-4df1-961b-2360721c5849 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.799396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71c007-d95e-4df1-961b-2360721c5849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.799509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71c007-d95e-4df1-961b-2360721c5849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.800386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71c007-d95e-4df1-961b-2360721c5849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.804039 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71c007-d95e-4df1-961b-2360721c5849 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.818482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 929/1852] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:34:57.821690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9105db0-e0c2-41fd-b9ff-4ae609f084b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13214f0d6534d90a5fbe335724ee801, user_id=bdeec0079ad544769c4c7dfa017f2dd8, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.829005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71c007-d95e-4df1-961b-2360721c5849 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.832477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9105db0-e0c2-41fd-b9ff-4ae609f084b6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.843085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71c007-d95e-4df1-961b-2360721c5849 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.847713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 924/1853] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:57 2022] PUT /identity/v3/projects/f13214f0d6534d90a5fbe335724ee801/users/bdeec0079ad544769c4c7dfa017f2dd8/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:57.851401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9105db0-e0c2-41fd-b9ff-4ae609f084b6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:57.908768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f203a-5957-40ac-b80a-5187e4db6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.909431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f203a-5957-40ac-b80a-5187e4db6b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.909823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f203a-5957-40ac-b80a-5187e4db6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.910097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f203a-5957-40ac-b80a-5187e4db6b91 admin admin] PATH_INFO: `/v3/projects/0e63070f2c784309997667bdfdbf7fb8/users/9f034b12bdc14a97ae81fd6ddee5d931/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.912098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f203a-5957-40ac-b80a-5187e4db6b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e63070f2c784309997667bdfdbf7fb8, user_id=9f034b12bdc14a97ae81fd6ddee5d931, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.914800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f203a-5957-40ac-b80a-5187e4db6b91 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.925730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 930/1854] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:57 2022] PUT /identity/v3/projects/0e63070f2c784309997667bdfdbf7fb8/users/9f034b12bdc14a97ae81fd6ddee5d931/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:57.929437 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9105db0-e0c2-41fd-b9ff-4ae609f084b6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:57.935714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6322eb1-f43d-4e1c-b1ca-7a4104412d97 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.935997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6322eb1-f43d-4e1c-b1ca-7a4104412d97 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.936272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6322eb1-f43d-4e1c-b1ca-7a4104412d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.964808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c6322eb1-f43d-4e1c-b1ca-7a4104412d97 None None] MFA Rules not processed for user `9f034b12bdc14a97ae81fd6ddee5d931`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:57.965980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c6322eb1-f43d-4e1c-b1ca-7a4104412d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:57.987364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feddda2-8563-4514-b90c-a766aeeaa467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:57.987965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feddda2-8563-4514-b90c-a766aeeaa467 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:57.988238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feddda2-8563-4514-b90c-a766aeeaa467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:57.988509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feddda2-8563-4514-b90c-a766aeeaa467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:57.989146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feddda2-8563-4514-b90c-a766aeeaa467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:57.990768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feddda2-8563-4514-b90c-a766aeeaa467 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:57.992019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:58.002960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 925/1855] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:34:58.007299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feddda2-8563-4514-b90c-a766aeeaa467 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:58.017993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feddda2-8563-4514-b90c-a766aeeaa467 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:58.024582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda88fb7-7e29-491f-b05e-4bed104a9017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:58.025316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88fb7-7e29-491f-b05e-4bed104a9017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:58.025739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88fb7-7e29-491f-b05e-4bed104a9017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:58.026091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88fb7-7e29-491f-b05e-4bed104a9017 admin admin] PATH_INFO: `/v3/projects/f13214f0d6534d90a5fbe335724ee801/users/bdeec0079ad544769c4c7dfa017f2dd8/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:58.029367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda88fb7-7e29-491f-b05e-4bed104a9017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13214f0d6534d90a5fbe335724ee801, user_id=bdeec0079ad544769c4c7dfa017f2dd8, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:58.032183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda88fb7-7e29-491f-b05e-4bed104a9017 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:58.038946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 931/1856] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:58.044636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 926/1857] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:34:58 2022] PUT /identity/v3/projects/f13214f0d6534d90a5fbe335724ee801/users/bdeec0079ad544769c4c7dfa017f2dd8/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:58.050606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6322eb1-f43d-4e1c-b1ca-7a4104412d97 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:58.052300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c6322eb1-f43d-4e1c-b1ca-7a4104412d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:58.055968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594a1a3-2df3-42a4-8802-ef0ca3fc21a0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:58.056264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594a1a3-2df3-42a4-8802-ef0ca3fc21a0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:58.056538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594a1a3-2df3-42a4-8802-ef0ca3fc21a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:58.088485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9594a1a3-2df3-42a4-8802-ef0ca3fc21a0 None None] MFA Rules not processed for user `bdeec0079ad544769c4c7dfa017f2dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:58.089754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9594a1a3-2df3-42a4-8802-ef0ca3fc21a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:58.122725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6322eb1-f43d-4e1c-b1ca-7a4104412d97 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:58.133533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:58.178554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b6b87-641f-479a-b37f-d7d0de82af24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:58.179198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b6b87-641f-479a-b37f-d7d0de82af24 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:58.179472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b6b87-641f-479a-b37f-d7d0de82af24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:58.179741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b6b87-641f-479a-b37f-d7d0de82af24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:58.183322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 927/1858] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:58.191603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594a1a3-2df3-42a4-8802-ef0ca3fc21a0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:58.193335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9594a1a3-2df3-42a4-8802-ef0ca3fc21a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:58.217978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594a1a3-2df3-42a4-8802-ef0ca3fc21a0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:58.222781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd28b-32a4-4db4-893b-15e296690087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:58.223477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd28b-32a4-4db4-893b-15e296690087 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:58.223847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd28b-32a4-4db4-893b-15e296690087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:58.224191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd28b-32a4-4db4-893b-15e296690087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:58.234371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcd28b-32a4-4db4-893b-15e296690087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:58.235541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcd28b-32a4-4db4-893b-15e296690087 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:58.248195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 928/1859] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:58.259456 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b6b87-641f-479a-b37f-d7d0de82af24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:58.260903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b6b87-641f-479a-b37f-d7d0de82af24 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:58.272606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 932/1860] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:34:58.404064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd28b-32a4-4db4-893b-15e296690087 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:58.415388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd28b-32a4-4db4-893b-15e296690087 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:58.421222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea5e5f-efd5-4907-a069-c882f0cc170b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:58.423329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5e5f-efd5-4907-a069-c882f0cc170b service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:58.424721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5e5f-efd5-4907-a069-c882f0cc170b service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:58.426174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5e5f-efd5-4907-a069-c882f0cc170b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:58.516728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea5e5f-efd5-4907-a069-c882f0cc170b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:58.520624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea5e5f-efd5-4907-a069-c882f0cc170b service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:58.533134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 929/1861] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:58.696086 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b6b87-641f-479a-b37f-d7d0de82af24 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:58.795003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b6b87-641f-479a-b37f-d7d0de82af24 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:58.799740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:58.801202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:58.801657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:58.802074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] PATH_INFO: `/v3/users/4af7a03823a04a8ca0676ff3697b4af2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:58.803678 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af7a03823a04a8ca0676ff3697b4af2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:58.805816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:58.871813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af7a03823a04a8ca0676ff3697b4af2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:58.891347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af7a03823a04a8ca0676ff3697b4af2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:58.899094 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:58.904947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af7a03823a04a8ca0676ff3697b4af2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:58.913932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af7a03823a04a8ca0676ff3697b4af2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:58.914857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af7a03823a04a8ca0676ff3697b4af2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:58.922677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 933/1862] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:58 2022] DELETE /identity/v3/users/4af7a03823a04a8ca0676ff3697b4af2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:58.928766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c318e45-dc19-44b8-b78f-a2f205050eb3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:58.929242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c318e45-dc19-44b8-b78f-a2f205050eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:58.929671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c318e45-dc19-44b8-b78f-a2f205050eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:58.968380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1c318e45-dc19-44b8-b78f-a2f205050eb3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:34:58.971492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1c318e45-dc19-44b8-b78f-a2f205050eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:59.048740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:59.083954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 930/1863] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:34:59.090984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:59.093078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:59.168440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390658e7-d314-47d6-8d30-028d8ce81a4a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:59.172808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd682f8-7950-40c4-ac9b-90c015dd4640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:59.173553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd682f8-7950-40c4-ac9b-90c015dd4640 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:59.173770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd682f8-7950-40c4-ac9b-90c015dd4640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:59.174329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd682f8-7950-40c4-ac9b-90c015dd4640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:59.187787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd682f8-7950-40c4-ac9b-90c015dd4640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:59.189500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd682f8-7950-40c4-ac9b-90c015dd4640 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:59.202832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 934/1864] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:59.588187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c318e45-dc19-44b8-b78f-a2f205050eb3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:59.590207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1c318e45-dc19-44b8-b78f-a2f205050eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:59.604496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c318e45-dc19-44b8-b78f-a2f205050eb3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:59.632992 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:59.634106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:59.634656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:59.635187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] PATH_INFO: `/v3/projects/c3c554f612d34f859d4ebd779f141e37` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:59.636681 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c554f612d34f859d4ebd779f141e37)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:59.640775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:59.725463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c554f612d34f859d4ebd779f141e37', 'request_id': 'req-27991526-aa52-4791-8624-37c0b58191a6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.734720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c554f612d34f859d4ebd779f141e37', 'request_id': 'req-27991526-aa52-4791-8624-37c0b58191a6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.746861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c554f612d34f859d4ebd779f141e37', 'request_id': 'req-27991526-aa52-4791-8624-37c0b58191a6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.771050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] The token cache is being invalidate because project c3c554f612d34f859d4ebd779f141e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:34:59.771388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.772321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.773826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 931/1865] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:34:59 2022] DELETE /identity/v3/projects/c3c554f612d34f859d4ebd779f141e37 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:34:59.779154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd682f8-7950-40c4-ac9b-90c015dd4640 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:59.793436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd682f8-7950-40c4-ac9b-90c015dd4640 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:59.874304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:59.875191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:59.875657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:59.876029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] PATH_INFO: `/v3/users/9f034b12bdc14a97ae81fd6ddee5d931` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:59.878027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f034b12bdc14a97ae81fd6ddee5d931)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:59.880361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:59.935400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f034b12bdc14a97ae81fd6ddee5d931'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.948276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f034b12bdc14a97ae81fd6ddee5d931'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.955460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f034b12bdc14a97ae81fd6ddee5d931'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.963414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f034b12bdc14a97ae81fd6ddee5d931'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.964135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd391ef8-7f6e-4736-86aa-4993b03a875f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f034b12bdc14a97ae81fd6ddee5d931'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:34:59.971960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 935/1866] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:34:59 2022] DELETE /identity/v3/users/9f034b12bdc14a97ae81fd6ddee5d931 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:00.453836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:00.457496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:00.474897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991526-aa52-4791-8624-37c0b58191a6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:00.587882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:00.588779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:00.589410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:00.590461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] PATH_INFO: `/v3/projects/0e63070f2c784309997667bdfdbf7fb8` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:00.592275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e63070f2c784309997667bdfdbf7fb8)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:00.598286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:00.751334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e63070f2c784309997667bdfdbf7fb8', 'request_id': 'req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:00.782258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e63070f2c784309997667bdfdbf7fb8', 'request_id': 'req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:00.788597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e63070f2c784309997667bdfdbf7fb8', 'request_id': 'req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:00.844076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] The token cache is being invalidate because project 0e63070f2c784309997667bdfdbf7fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:00.844634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:00.846281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1e4892c1-4686-4cb2-a18f-2e6e1e9d3b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:00.856547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e2f3e-4654-4f2e-84f0-530213a87da2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:00.857385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e2f3e-4654-4f2e-84f0-530213a87da2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:00.857835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e2f3e-4654-4f2e-84f0-530213a87da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:00.861700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 932/1867] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:00 2022] DELETE /identity/v3/projects/0e63070f2c784309997667bdfdbf7fb8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:00.873385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:00.889707 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e19e2f3e-4654-4f2e-84f0-530213a87da2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:00.898772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e19e2f3e-4654-4f2e-84f0-530213a87da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:01.017317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64f31-294d-4eea-9a02-80d432b8ded2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:01.017524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64f31-294d-4eea-9a02-80d432b8ded2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:01.017861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64f31-294d-4eea-9a02-80d432b8ded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:01.032111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 936/1868] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:01.050726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:01.062593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-36f64f31-294d-4eea-9a02-80d432b8ded2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:01.066079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-36f64f31-294d-4eea-9a02-80d432b8ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:01.097984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e2f3e-4654-4f2e-84f0-530213a87da2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:01.108909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 933/1869] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:01.118562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e2f3e-4654-4f2e-84f0-530213a87da2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:01.126719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30e042-78f5-4c4d-a3ff-3ea5b691542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:01.128708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e042-78f5-4c4d-a3ff-3ea5b691542f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:01.129533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e042-78f5-4c4d-a3ff-3ea5b691542f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:01.129918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e042-78f5-4c4d-a3ff-3ea5b691542f admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:01.130744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e042-78f5-4c4d-a3ff-3ea5b691542f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:01.131149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e042-78f5-4c4d-a3ff-3ea5b691542f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:01.133482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e042-78f5-4c4d-a3ff-3ea5b691542f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:01.161676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64f31-294d-4eea-9a02-80d432b8ded2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:01.171992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 937/1870] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:01.183782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64f31-294d-4eea-9a02-80d432b8ded2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:01.199243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b732672-6694-4902-835d-87bac8025153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:01.200565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b732672-6694-4902-835d-87bac8025153 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:01.201230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b732672-6694-4902-835d-87bac8025153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:01.201652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b732672-6694-4902-835d-87bac8025153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:01.203097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b732672-6694-4902-835d-87bac8025153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:01.208006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b732672-6694-4902-835d-87bac8025153 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:01.246326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 934/1871] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:01 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:01.251352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30e042-78f5-4c4d-a3ff-3ea5b691542f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:01.273029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30e042-78f5-4c4d-a3ff-3ea5b691542f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:01.380823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c8262-d30c-4740-8048-d5cf75403217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:01.381580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8262-d30c-4740-8048-d5cf75403217 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:01.381962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8262-d30c-4740-8048-d5cf75403217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:01.382354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8262-d30c-4740-8048-d5cf75403217 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:01.383829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c8262-d30c-4740-8048-d5cf75403217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:01.386390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c8262-d30c-4740-8048-d5cf75403217 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:01.418408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 938/1872] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:01 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:01.433019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b732672-6694-4902-835d-87bac8025153 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:01.448055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b732672-6694-4902-835d-87bac8025153 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:01.453602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658f93-b9ac-4943-99e2-83efb88bbe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:01.454173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658f93-b9ac-4943-99e2-83efb88bbe63 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:01.454458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658f93-b9ac-4943-99e2-83efb88bbe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:01.454806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658f93-b9ac-4943-99e2-83efb88bbe63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:01.455522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658f93-b9ac-4943-99e2-83efb88bbe63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:01.457560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658f93-b9ac-4943-99e2-83efb88bbe63 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:01.472639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 935/1873] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:01.478309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c8262-d30c-4740-8048-d5cf75403217 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:01.494186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c8262-d30c-4740-8048-d5cf75403217 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:01.504004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd5a0-42ad-4ad8-be78-1c03cbf50d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:01.505194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd5a0-42ad-4ad8-be78-1c03cbf50d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:01.505780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd5a0-42ad-4ad8-be78-1c03cbf50d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:01.506277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd5a0-42ad-4ad8-be78-1c03cbf50d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:01.507248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd5a0-42ad-4ad8-be78-1c03cbf50d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:01.509318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd5a0-42ad-4ad8-be78-1c03cbf50d87 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:01.526356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 939/1874] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:01.531100 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658f93-b9ac-4943-99e2-83efb88bbe63 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:01.557454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658f93-b9ac-4943-99e2-83efb88bbe63 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:01.564141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef1dcd-95f9-4f3c-b929-9662628c87d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:01.565616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1dcd-95f9-4f3c-b929-9662628c87d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:01.566073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1dcd-95f9-4f3c-b929-9662628c87d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:01.566499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1dcd-95f9-4f3c-b929-9662628c87d9 admin admin] PATH_INFO: `/v3/projects/b6ad0a5b5a774e44b5ca646d2b197a87/users/3cc9af1b6ab943fbac9805b207870457/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:01.592714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef1dcd-95f9-4f3c-b929-9662628c87d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ad0a5b5a774e44b5ca646d2b197a87, user_id=3cc9af1b6ab943fbac9805b207870457, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:01.595601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef1dcd-95f9-4f3c-b929-9662628c87d9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:01.619588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 936/1875] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:01 2022] PUT /identity/v3/projects/b6ad0a5b5a774e44b5ca646d2b197a87/users/3cc9af1b6ab943fbac9805b207870457/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:01.631568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b89726-b126-4c57-aaf6-37b2779e7949 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:01.631854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b89726-b126-4c57-aaf6-37b2779e7949 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:01.632138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b89726-b126-4c57-aaf6-37b2779e7949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:01.689330 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-91b89726-b126-4c57-aaf6-37b2779e7949 None None] MFA Rules not processed for user `3cc9af1b6ab943fbac9805b207870457`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:01.690916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-91b89726-b126-4c57-aaf6-37b2779e7949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:01.768647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:01.777993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 940/1876] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:01.789741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef1dcd-95f9-4f3c-b929-9662628c87d9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:01.792436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-abef1dcd-95f9-4f3c-b929-9662628c87d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:01.876468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef1dcd-95f9-4f3c-b929-9662628c87d9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:01.882078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033f855-abf3-409d-9ca0-a31fd26d09cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:01.883357 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033f855-abf3-409d-9ca0-a31fd26d09cd service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:01.883783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033f855-abf3-409d-9ca0-a31fd26d09cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:01.884297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033f855-abf3-409d-9ca0-a31fd26d09cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:01.912082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033f855-abf3-409d-9ca0-a31fd26d09cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:01.915116 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033f855-abf3-409d-9ca0-a31fd26d09cd service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:01.930908 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 937/1877] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:01.959251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b89726-b126-4c57-aaf6-37b2779e7949 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:02.136989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b89726-b126-4c57-aaf6-37b2779e7949 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:02.155562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:02.156238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:02.156517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:02.156795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] PATH_INFO: `/v3/users/3cc9af1b6ab943fbac9805b207870457` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:02.160726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc9af1b6ab943fbac9805b207870457)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:02.163798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:02.292932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc9af1b6ab943fbac9805b207870457'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:02.325118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc9af1b6ab943fbac9805b207870457'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:02.345189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc9af1b6ab943fbac9805b207870457'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:02.368644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc9af1b6ab943fbac9805b207870457'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:02.369323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc9af1b6ab943fbac9805b207870457'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:02.379459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 941/1878] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:01 2022] DELETE /identity/v3/users/3cc9af1b6ab943fbac9805b207870457 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:02.384714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d26c9-46e9-4b51-aa18-63115c14c57e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:02.385525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d26c9-46e9-4b51-aa18-63115c14c57e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:02.386210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d26c9-46e9-4b51-aa18-63115c14c57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:02.423301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e85d26c9-46e9-4b51-aa18-63115c14c57e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:02.425915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e85d26c9-46e9-4b51-aa18-63115c14c57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:02.576714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 938/1879] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:02.646780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:02.649712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:02.841238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba8237-a019-4730-8c2a-1c529a5744fc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:02.852312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d26c9-46e9-4b51-aa18-63115c14c57e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:02.854583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faaade-8c30-4240-ae8b-9fd300b3b743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:02.855260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faaade-8c30-4240-ae8b-9fd300b3b743 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:02.855534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faaade-8c30-4240-ae8b-9fd300b3b743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:02.855783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faaade-8c30-4240-ae8b-9fd300b3b743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:02.856041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e85d26c9-46e9-4b51-aa18-63115c14c57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:02.880851 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faaade-8c30-4240-ae8b-9fd300b3b743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:02.881447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faaade-8c30-4240-ae8b-9fd300b3b743 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:02.907970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 942/1880] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:02.912327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d26c9-46e9-4b51-aa18-63115c14c57e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:02.955058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:02.958642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:02.958642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:02.958642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] PATH_INFO: `/v3/users/3ecc25b305c74f9ca423999d0e863964` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:02.972472 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecc25b305c74f9ca423999d0e863964)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:02.974970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:03.152392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:03.168696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecc25b305c74f9ca423999d0e863964'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:03.198068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecc25b305c74f9ca423999d0e863964'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:03.199532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecc25b305c74f9ca423999d0e863964'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:03.254366 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecc25b305c74f9ca423999d0e863964'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:03.276649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecc25b305c74f9ca423999d0e863964'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:03.334043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 939/1881] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:02 2022] DELETE /identity/v3/users/3ecc25b305c74f9ca423999d0e863964 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:03.334832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd927ed-b315-4297-ad07-223daa2ae860 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:03.335489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd927ed-b315-4297-ad07-223daa2ae860 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:03.335647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd927ed-b315-4297-ad07-223daa2ae860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:03.373378 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6bd927ed-b315-4297-ad07-223daa2ae860 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:03.374971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6bd927ed-b315-4297-ad07-223daa2ae860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:03.396649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:03.511043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 943/1882] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:03.545601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:03.547097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:03.711902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21a2a-e71f-427c-a805-0b038546ab73 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:03.727447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6bc50-9121-472f-b793-e97623a57d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:03.729337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6bc50-9121-472f-b793-e97623a57d42 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:03.730921 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6bc50-9121-472f-b793-e97623a57d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:03.732029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6bc50-9121-472f-b793-e97623a57d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:03.754041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6bc50-9121-472f-b793-e97623a57d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:03.755591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6bc50-9121-472f-b793-e97623a57d42 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:03.769566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 940/1883] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:04.623608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd927ed-b315-4297-ad07-223daa2ae860 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:04.626128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6bd927ed-b315-4297-ad07-223daa2ae860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:04.642139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd927ed-b315-4297-ad07-223daa2ae860 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:04.648785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:04.649433 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:04.650446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:04.650446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] PATH_INFO: `/v3/projects/bad84738a69a406aaae89c94c08e206d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:04.651167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad84738a69a406aaae89c94c08e206d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:04.653096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:04.733409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad84738a69a406aaae89c94c08e206d', 'request_id': 'req-5bf201be-60dd-4317-a70c-87492872eada'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:04.747773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad84738a69a406aaae89c94c08e206d', 'request_id': 'req-5bf201be-60dd-4317-a70c-87492872eada'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:04.758064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad84738a69a406aaae89c94c08e206d', 'request_id': 'req-5bf201be-60dd-4317-a70c-87492872eada'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:04.776111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] The token cache is being invalidate because project bad84738a69a406aaae89c94c08e206d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:04.776410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:04.777228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:04.780509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 944/1884] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:04 2022] DELETE /identity/v3/projects/bad84738a69a406aaae89c94c08e206d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:04.784517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6bc50-9121-472f-b793-e97623a57d42 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:04.797683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6bc50-9121-472f-b793-e97623a57d42 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:04.867009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:04.868740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:04.879624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:04.880612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:04.881097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:04.881604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] PATH_INFO: `/v3/users/b9b5b98a45cc49729537bdf3ee39dd30` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:04.883005 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b5b98a45cc49729537bdf3ee39dd30)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:04.885590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:04.967957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b5b98a45cc49729537bdf3ee39dd30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:04.985288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b5b98a45cc49729537bdf3ee39dd30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:04.986160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b5b98a45cc49729537bdf3ee39dd30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:04.997759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:05.018526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b5b98a45cc49729537bdf3ee39dd30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.019795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf201be-60dd-4317-a70c-87492872eada admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:05.028741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b5b98a45cc49729537bdf3ee39dd30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.037344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 941/1885] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:04 2022] DELETE /identity/v3/users/b9b5b98a45cc49729537bdf3ee39dd30 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:05.040505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:05.043592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.043748 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.043989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] PATH_INFO: `/v3/projects/b6ad0a5b5a774e44b5ca646d2b197a87` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.045497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ad0a5b5a774e44b5ca646d2b197a87)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:05.047535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:05.127636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:05.129503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ad0a5b5a774e44b5ca646d2b197a87', 'request_id': 'req-692e390c-cb03-4345-be1c-b0c638a8f9ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.143461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ad0a5b5a774e44b5ca646d2b197a87', 'request_id': 'req-692e390c-cb03-4345-be1c-b0c638a8f9ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.154602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ad0a5b5a774e44b5ca646d2b197a87', 'request_id': 'req-692e390c-cb03-4345-be1c-b0c638a8f9ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.190712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] The token cache is being invalidate because project b6ad0a5b5a774e44b5ca646d2b197a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:05.191046 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.192082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:05.192269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-692e390c-cb03-4345-be1c-b0c638a8f9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.193892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:05.198024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 945/1886] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:04 2022] DELETE /identity/v3/projects/b6ad0a5b5a774e44b5ca646d2b197a87 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:05.199860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9908-89d2-4beb-a8d2-1366188d7ace None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.201176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9908-89d2-4beb-a8d2-1366188d7ace None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.201407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9908-89d2-4beb-a8d2-1366188d7ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.238820 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-624f9908-89d2-4beb-a8d2-1366188d7ace None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:05.240073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-624f9908-89d2-4beb-a8d2-1366188d7ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:05.357710 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b69b0-a2af-4924-a896-b0d49ea87976 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:05.428988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 946/1887] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:05.430574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76282a4-aab2-46e9-baa5-fdc06d0c6196 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.431667 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76282a4-aab2-46e9-baa5-fdc06d0c6196 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.431951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76282a4-aab2-46e9-baa5-fdc06d0c6196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.496457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:05.497697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.498135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.498554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] PATH_INFO: `/v3/users/93dbfac46c6845b79d7db1a6046213cc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.500548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93dbfac46c6845b79d7db1a6046213cc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:05.503693 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:05.504491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b76282a4-aab2-46e9-baa5-fdc06d0c6196 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:05.505761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b76282a4-aab2-46e9-baa5-fdc06d0c6196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:05.533573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 947/1888] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:05.540421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e9f3-77f7-48f1-ba47-425b1b66a937 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.541610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e9f3-77f7-48f1-ba47-425b1b66a937 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.541905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e9f3-77f7-48f1-ba47-425b1b66a937 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.547483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 948/1889] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:35:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:35:05.548351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e9f3-77f7-48f1-ba47-425b1b66a937 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:05.578610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e9f3-77f7-48f1-ba47-425b1b66a937 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:05.593731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:05.595043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.596447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.596736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.597606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:05.598363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:05.601397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:05.605701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93dbfac46c6845b79d7db1a6046213cc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.624449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93dbfac46c6845b79d7db1a6046213cc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.625123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93dbfac46c6845b79d7db1a6046213cc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.632067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 949/1890] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:05.638907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:05.645262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:05.653712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93dbfac46c6845b79d7db1a6046213cc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.672286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ac8f3c9-abc2-4dbf-8a2d-1a9405504078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93dbfac46c6845b79d7db1a6046213cc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.684737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 942/1891] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:05 2022] DELETE /identity/v3/users/93dbfac46c6845b79d7db1a6046213cc => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:05.686892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caea64-9b4d-4585-81d2-c44d295fba3e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:05.688814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c98631-4def-47d5-998d-5d71b1709fbd None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.689102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c98631-4def-47d5-998d-5d71b1709fbd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.689383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c98631-4def-47d5-998d-5d71b1709fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.717051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:05.740420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e5c98631-4def-47d5-998d-5d71b1709fbd None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:05.743066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e5c98631-4def-47d5-998d-5d71b1709fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:05.844827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 943/1892] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:35:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:05.846383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c98631-4def-47d5-998d-5d71b1709fbd None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:05.850922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e5c98631-4def-47d5-998d-5d71b1709fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:05.860043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:05.860706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.860989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.861315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] PATH_INFO: `/v3/projects/102cfc33ae504749929e17c7407a0dee` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.862599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=102cfc33ae504749929e17c7407a0dee)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:05.864849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:05.868549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c98631-4def-47d5-998d-5d71b1709fbd None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:05.873233 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8839b-3bfc-4f2c-9fd4-4529e6e3d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:05.873841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8839b-3bfc-4f2c-9fd4-4529e6e3d00a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.874118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8839b-3bfc-4f2c-9fd4-4529e6e3d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.874402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8839b-3bfc-4f2c-9fd4-4529e6e3d00a admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.875206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8839b-3bfc-4f2c-9fd4-4529e6e3d00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:05.877595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8839b-3bfc-4f2c-9fd4-4529e6e3d00a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:05.923968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 944/1893] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:05 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:05.923968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7a92c-287a-43b9-b0b4-715c3e4789d3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:05.923968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7a92c-287a-43b9-b0b4-715c3e4789d3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:05.923968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7a92c-287a-43b9-b0b4-715c3e4789d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:05.947490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-03c7a92c-287a-43b9-b0b4-715c3e4789d3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:05.948840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-03c7a92c-287a-43b9-b0b4-715c3e4789d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:05.982341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102cfc33ae504749929e17c7407a0dee', 'request_id': 'req-1d84a552-9b90-4d1f-91c2-de9114beee7e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:05.996722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102cfc33ae504749929e17c7407a0dee', 'request_id': 'req-1d84a552-9b90-4d1f-91c2-de9114beee7e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:06.000601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:06.010926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102cfc33ae504749929e17c7407a0dee', 'request_id': 'req-1d84a552-9b90-4d1f-91c2-de9114beee7e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:06.035154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] The token cache is being invalidate because project 102cfc33ae504749929e17c7407a0dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:06.035458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:06.036366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:06.041044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 950/1894] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:05 2022] DELETE /identity/v3/projects/102cfc33ae504749929e17c7407a0dee => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:06.041044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.042926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:06.055561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 945/1895] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:06.056882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7a92c-287a-43b9-b0b4-715c3e4789d3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.058947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-03c7a92c-287a-43b9-b0b4-715c3e4789d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:06.092700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7a92c-287a-43b9-b0b4-715c3e4789d3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.104841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713a17b-ba0a-4bda-8c00-51dd7698e5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.107211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713a17b-ba0a-4bda-8c00-51dd7698e5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.107570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713a17b-ba0a-4bda-8c00-51dd7698e5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.107905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713a17b-ba0a-4bda-8c00-51dd7698e5e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.109536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713a17b-ba0a-4bda-8c00-51dd7698e5e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.115058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713a17b-ba0a-4bda-8c00-51dd7698e5e7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.163315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 946/1896] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:06 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:06.165011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3802-fea2-4223-9fa0-45bc056577d2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.165585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3802-fea2-4223-9fa0-45bc056577d2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.166212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3802-fea2-4223-9fa0-45bc056577d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.222154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e55f3802-fea2-4223-9fa0-45bc056577d2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:06.223569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e55f3802-fea2-4223-9fa0-45bc056577d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:06.233174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 947/1897] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:06.234299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3802-fea2-4223-9fa0-45bc056577d2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.236255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e55f3802-fea2-4223-9fa0-45bc056577d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:06.245389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a552-9b90-4d1f-91c2-de9114beee7e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.255339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79963c84-5dff-4934-b1cc-d0f1342487ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.256328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79963c84-5dff-4934-b1cc-d0f1342487ab service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.257831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79963c84-5dff-4934-b1cc-d0f1342487ab service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.258315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79963c84-5dff-4934-b1cc-d0f1342487ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.260147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-79963c84-5dff-4934-b1cc-d0f1342487ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:06.275433 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79963c84-5dff-4934-b1cc-d0f1342487ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.277288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79963c84-5dff-4934-b1cc-d0f1342487ab service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.291516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 951/1898] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:06.292187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79963c84-5dff-4934-b1cc-d0f1342487ab service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.300807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3802-fea2-4223-9fa0-45bc056577d2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.305843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79963c84-5dff-4934-b1cc-d0f1342487ab service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.307937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d666af2-8581-415b-a783-f57a8327d2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.308717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d666af2-8581-415b-a783-f57a8327d2ee service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.309030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d666af2-8581-415b-a783-f57a8327d2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.309428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d666af2-8581-415b-a783-f57a8327d2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.311941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0934a1-7ec7-4c1f-9c59-f6fc408b3326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.312702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0934a1-7ec7-4c1f-9c59-f6fc408b3326 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.313125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0934a1-7ec7-4c1f-9c59-f6fc408b3326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.313537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0934a1-7ec7-4c1f-9c59-f6fc408b3326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.314339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0934a1-7ec7-4c1f-9c59-f6fc408b3326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.316940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0934a1-7ec7-4c1f-9c59-f6fc408b3326 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.322671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:06.329473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d666af2-8581-415b-a783-f57a8327d2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.330234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 952/1899] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:06.331519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d8973-d295-4ea5-a529-2550d3445ca8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.331791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d8973-d295-4ea5-a529-2550d3445ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.332137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d8973-d295-4ea5-a529-2550d3445ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.340697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d666af2-8581-415b-a783-f57a8327d2ee service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.354156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 948/1900] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:06.355295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d666af2-8581-415b-a783-f57a8327d2ee service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.382014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5b3d8973-d295-4ea5-a529-2550d3445ca8 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:06.383485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5b3d8973-d295-4ea5-a529-2550d3445ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:06.390618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d666af2-8581-415b-a783-f57a8327d2ee service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.398635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e808d-e757-4406-a097-e6b7942dd623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.399438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e808d-e757-4406-a097-e6b7942dd623 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.399822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e808d-e757-4406-a097-e6b7942dd623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.400314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e808d-e757-4406-a097-e6b7942dd623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.401094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e808d-e757-4406-a097-e6b7942dd623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.402803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e808d-e757-4406-a097-e6b7942dd623 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.411016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 953/1901] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:06.415666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d8973-d295-4ea5-a529-2550d3445ca8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.416696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 949/1902] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:06.421421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e808d-e757-4406-a097-e6b7942dd623 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.426809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d8973-d295-4ea5-a529-2550d3445ca8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.433547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1e444-39f1-42e9-80ab-f2360927a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.434665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1e444-39f1-42e9-80ab-f2360927a257 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.435182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1e444-39f1-42e9-80ab-f2360927a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.435755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1e444-39f1-42e9-80ab-f2360927a257 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.436722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1e444-39f1-42e9-80ab-f2360927a257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:06.437255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1e444-39f1-42e9-80ab-f2360927a257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.440563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1e444-39f1-42e9-80ab-f2360927a257 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.448535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e808d-e757-4406-a097-e6b7942dd623 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.455972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 954/1903] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:35:06.460084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1e444-39f1-42e9-80ab-f2360927a257 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.468475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431bf61-c220-4a01-b701-ff056e9b0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.469242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431bf61-c220-4a01-b701-ff056e9b0a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.469596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431bf61-c220-4a01-b701-ff056e9b0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.470030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431bf61-c220-4a01-b701-ff056e9b0a03 admin admin] PATH_INFO: `/v3/projects/e73be1d5745a42b990d7d8dc7ca169fd/users/ff32f25e21e74be28846c22121057ed4/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.491158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431bf61-c220-4a01-b701-ff056e9b0a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73be1d5745a42b990d7d8dc7ca169fd, user_id=ff32f25e21e74be28846c22121057ed4, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.493234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1e444-39f1-42e9-80ab-f2360927a257 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.494208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431bf61-c220-4a01-b701-ff056e9b0a03 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.499429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a06a-5b34-4a14-8e5e-9cc9db56e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.500217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a06a-5b34-4a14-8e5e-9cc9db56e3da admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.500499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a06a-5b34-4a14-8e5e-9cc9db56e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.500783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a06a-5b34-4a14-8e5e-9cc9db56e3da admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.501617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a06a-5b34-4a14-8e5e-9cc9db56e3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.504899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a06a-5b34-4a14-8e5e-9cc9db56e3da admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.515927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 950/1904] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:06 2022] PUT /identity/v3/projects/e73be1d5745a42b990d7d8dc7ca169fd/users/ff32f25e21e74be28846c22121057ed4/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:06.527182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a10b7-b01f-4912-9112-48e7654e176b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.527552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a10b7-b01f-4912-9112-48e7654e176b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.527753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a10b7-b01f-4912-9112-48e7654e176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.539593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 955/1905] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:06 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:06.543945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a06a-5b34-4a14-8e5e-9cc9db56e3da admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.562913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b44a10b7-b01f-4912-9112-48e7654e176b None None] MFA Rules not processed for user `ff32f25e21e74be28846c22121057ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:06.564141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b44a10b7-b01f-4912-9112-48e7654e176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:06.624139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a06a-5b34-4a14-8e5e-9cc9db56e3da admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.629540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447e18-62c8-4fbc-880d-048a62d5edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.630245 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447e18-62c8-4fbc-880d-048a62d5edce admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.630504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447e18-62c8-4fbc-880d-048a62d5edce admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.630806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447e18-62c8-4fbc-880d-048a62d5edce admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.631636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62447e18-62c8-4fbc-880d-048a62d5edce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.633645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62447e18-62c8-4fbc-880d-048a62d5edce admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.655673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 951/1906] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:06.660660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a10b7-b01f-4912-9112-48e7654e176b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.662884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 956/1907] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:06 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:06.670722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447e18-62c8-4fbc-880d-048a62d5edce admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.686802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a10b7-b01f-4912-9112-48e7654e176b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.705385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8a9ce-3227-4c81-ad4d-d80f144ce958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.706671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8a9ce-3227-4c81-ad4d-d80f144ce958 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.707872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8a9ce-3227-4c81-ad4d-d80f144ce958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.708386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8a9ce-3227-4c81-ad4d-d80f144ce958 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.709383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8a9ce-3227-4c81-ad4d-d80f144ce958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.711467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447e18-62c8-4fbc-880d-048a62d5edce admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.712361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8a9ce-3227-4c81-ad4d-d80f144ce958 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.725944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a989-3baf-4dc7-906d-042e8a3fd663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.726664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a989-3baf-4dc7-906d-042e8a3fd663 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.727092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a989-3baf-4dc7-906d-042e8a3fd663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.727915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a989-3baf-4dc7-906d-042e8a3fd663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.728852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52a989-3baf-4dc7-906d-042e8a3fd663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.732853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52a989-3baf-4dc7-906d-042e8a3fd663 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.739482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:06.759555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 957/1908] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:06.760613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a989-3baf-4dc7-906d-042e8a3fd663 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.766973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 952/1909] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:06 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:06.771399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8a9ce-3227-4c81-ad4d-d80f144ce958 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.785971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a989-3baf-4dc7-906d-042e8a3fd663 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.896782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8a9ce-3227-4c81-ad4d-d80f144ce958 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.902248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81ccc4-c56c-48e1-88c9-4aca597f29d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.902901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81ccc4-c56c-48e1-88c9-4aca597f29d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.903179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81ccc4-c56c-48e1-88c9-4aca597f29d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.903447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81ccc4-c56c-48e1-88c9-4aca597f29d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.904104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81ccc4-c56c-48e1-88c9-4aca597f29d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.906106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81ccc4-c56c-48e1-88c9-4aca597f29d4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.957486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 953/1910] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:06 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:06.959844 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81ccc4-c56c-48e1-88c9-4aca597f29d4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.965959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ece6d7-f5c8-423b-b92f-5cd03003e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.966588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ece6d7-f5c8-423b-b92f-5cd03003e238 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.966915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ece6d7-f5c8-423b-b92f-5cd03003e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.967191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ece6d7-f5c8-423b-b92f-5cd03003e238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.968177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ece6d7-f5c8-423b-b92f-5cd03003e238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:06.969965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ece6d7-f5c8-423b-b92f-5cd03003e238 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:06.985306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 958/1911] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:06.985495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81ccc4-c56c-48e1-88c9-4aca597f29d4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:06.988251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ece6d7-f5c8-423b-b92f-5cd03003e238 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:06.996383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864352ef-343c-47de-9c98-97108b7156d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:06.997048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864352ef-343c-47de-9c98-97108b7156d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:06.997371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864352ef-343c-47de-9c98-97108b7156d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:06.997649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864352ef-343c-47de-9c98-97108b7156d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:06.998737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864352ef-343c-47de-9c98-97108b7156d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.000140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864352ef-343c-47de-9c98-97108b7156d1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.016572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ece6d7-f5c8-423b-b92f-5cd03003e238 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.022615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eaa95-88c6-4b9c-88bd-9bf395fe3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.023521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eaa95-88c6-4b9c-88bd-9bf395fe3917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.023812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eaa95-88c6-4b9c-88bd-9bf395fe3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.024091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eaa95-88c6-4b9c-88bd-9bf395fe3917 admin admin] PATH_INFO: `/v3/projects/43cd69b3731f45a2a5feb6171b671faa/users/2a91b60282b2443a92d8df5d3088c84c/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.049305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 954/1912] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:07.051169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864352ef-343c-47de-9c98-97108b7156d1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.059045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eaa95-88c6-4b9c-88bd-9bf395fe3917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cd69b3731f45a2a5feb6171b671faa, user_id=2a91b60282b2443a92d8df5d3088c84c, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.061757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eaa95-88c6-4b9c-88bd-9bf395fe3917 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.066285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864352ef-343c-47de-9c98-97108b7156d1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.073122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d99e6-0561-4c67-9521-47a4aa91401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.073965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d99e6-0561-4c67-9521-47a4aa91401c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.075460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d99e6-0561-4c67-9521-47a4aa91401c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.075766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d99e6-0561-4c67-9521-47a4aa91401c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.077147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d99e6-0561-4c67-9521-47a4aa91401c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.079258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d99e6-0561-4c67-9521-47a4aa91401c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.082109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:07.094336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 959/1913] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:06 2022] PUT /identity/v3/projects/43cd69b3731f45a2a5feb6171b671faa/users/2a91b60282b2443a92d8df5d3088c84c/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:07.106214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802228e-d008-41eb-b482-f43fbfb2733b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.106510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802228e-d008-41eb-b482-f43fbfb2733b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.106822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802228e-d008-41eb-b482-f43fbfb2733b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.116270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 955/1914] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:07.116925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d99e6-0561-4c67-9521-47a4aa91401c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.130188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d99e6-0561-4c67-9521-47a4aa91401c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.152414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a802228e-d008-41eb-b482-f43fbfb2733b None None] MFA Rules not processed for user `2a91b60282b2443a92d8df5d3088c84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:07.153562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a802228e-d008-41eb-b482-f43fbfb2733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:07.246225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 960/1915] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:07.251469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802228e-d008-41eb-b482-f43fbfb2733b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.259076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b85c1-ffc0-4992-af4d-5be95e66eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.259759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b85c1-ffc0-4992-af4d-5be95e66eccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.260040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b85c1-ffc0-4992-af4d-5be95e66eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.260496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b85c1-ffc0-4992-af4d-5be95e66eccf admin admin] PATH_INFO: `/v3/projects/25c1a22fa1af4ccfaa882e9be467bd23/users/cec02d954d264199a6e6343b7f141300/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.263969 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802228e-d008-41eb-b482-f43fbfb2733b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.278069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd4162-b838-4d16-a399-cd5f4ce013fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.279819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b85c1-ffc0-4992-af4d-5be95e66eccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c1a22fa1af4ccfaa882e9be467bd23, user_id=cec02d954d264199a6e6343b7f141300, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.281998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd4162-b838-4d16-a399-cd5f4ce013fd admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.282291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd4162-b838-4d16-a399-cd5f4ce013fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.282573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd4162-b838-4d16-a399-cd5f4ce013fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.282879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b85c1-ffc0-4992-af4d-5be95e66eccf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.283425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd4162-b838-4d16-a399-cd5f4ce013fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.286921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd4162-b838-4d16-a399-cd5f4ce013fd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.303210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 956/1916] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:07 2022] PUT /identity/v3/projects/25c1a22fa1af4ccfaa882e9be467bd23/users/cec02d954d264199a6e6343b7f141300/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:07.314093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89979a-5e55-4153-8784-6e834917b380 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.314378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89979a-5e55-4153-8784-6e834917b380 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.315277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89979a-5e55-4153-8784-6e834917b380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.344413 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 961/1917] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:07 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:07.354535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ea89979a-5e55-4153-8784-6e834917b380 None None] MFA Rules not processed for user `cec02d954d264199a6e6343b7f141300`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:07.355845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ea89979a-5e55-4153-8784-6e834917b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:07.365284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd4162-b838-4d16-a399-cd5f4ce013fd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.428893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:07.468523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd4162-b838-4d16-a399-cd5f4ce013fd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.483565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 957/1918] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:07.484695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94291883-66a0-480f-8dd6-fa8a7f250b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.485329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291883-66a0-480f-8dd6-fa8a7f250b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.485607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291883-66a0-480f-8dd6-fa8a7f250b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.485901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291883-66a0-480f-8dd6-fa8a7f250b0b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.488542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94291883-66a0-480f-8dd6-fa8a7f250b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.489847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89979a-5e55-4153-8784-6e834917b380 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.490520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94291883-66a0-480f-8dd6-fa8a7f250b0b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.502616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89979a-5e55-4153-8784-6e834917b380 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.509697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40a30f-f5c0-4d94-a21e-88f6ead0b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.510465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40a30f-f5c0-4d94-a21e-88f6ead0b2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.510953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40a30f-f5c0-4d94-a21e-88f6ead0b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.511362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40a30f-f5c0-4d94-a21e-88f6ead0b2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.512141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40a30f-f5c0-4d94-a21e-88f6ead0b2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.514372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40a30f-f5c0-4d94-a21e-88f6ead0b2b1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.519201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 962/1919] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:07 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:07.523235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94291883-66a0-480f-8dd6-fa8a7f250b0b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.537016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94291883-66a0-480f-8dd6-fa8a7f250b0b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.545221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ded4d-4724-473e-a3d5-bd7a618fe201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.549621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ded4d-4724-473e-a3d5-bd7a618fe201 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.549621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ded4d-4724-473e-a3d5-bd7a618fe201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.549621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ded4d-4724-473e-a3d5-bd7a618fe201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.549621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ded4d-4724-473e-a3d5-bd7a618fe201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.551941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ded4d-4724-473e-a3d5-bd7a618fe201 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.559901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 958/1920] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:07 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:07.561161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40a30f-f5c0-4d94-a21e-88f6ead0b2b1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.564482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7b40a30f-f5c0-4d94-a21e-88f6ead0b2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:07.571391 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 963/1921] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:07.579641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ded4d-4724-473e-a3d5-bd7a618fe201 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.598980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ded4d-4724-473e-a3d5-bd7a618fe201 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.649787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:07.670502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40a30f-f5c0-4d94-a21e-88f6ead0b2b1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.679299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.679892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.680253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.680439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] PATH_INFO: `/v3/projects/9c04f453692b4b8cbf2967af4d7cc8c7` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.682056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c04f453692b4b8cbf2967af4d7cc8c7)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.684544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.702298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4c48a-4861-4567-a7b4-6597f6164942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.703064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4c48a-4861-4567-a7b4-6597f6164942 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.703415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4c48a-4861-4567-a7b4-6597f6164942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.703769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4c48a-4861-4567-a7b4-6597f6164942 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.704488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4c48a-4861-4567-a7b4-6597f6164942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.707570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4c48a-4861-4567-a7b4-6597f6164942 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.730635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 964/1922] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:07 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:07.731680 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4c48a-4861-4567-a7b4-6597f6164942 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.742556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4c48a-4861-4567-a7b4-6597f6164942 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.746034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c04f453692b4b8cbf2967af4d7cc8c7', 'request_id': 'req-f05de903-dbcb-4e1e-9346-224cb118e9bc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:07.753381 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c04f453692b4b8cbf2967af4d7cc8c7', 'request_id': 'req-f05de903-dbcb-4e1e-9346-224cb118e9bc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:07.759508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c04f453692b4b8cbf2967af4d7cc8c7', 'request_id': 'req-f05de903-dbcb-4e1e-9346-224cb118e9bc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:07.773056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] The token cache is being invalidate because project 9c04f453692b4b8cbf2967af4d7cc8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:07.773344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:07.773988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:07.775958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 959/1923] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:07 2022] DELETE /identity/v3/projects/9c04f453692b4b8cbf2967af4d7cc8c7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:07.776480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.779648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:07.803362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bdba2-c782-4c0d-add9-913eb0fb4476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.804186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdba2-c782-4c0d-add9-913eb0fb4476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.804476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdba2-c782-4c0d-add9-913eb0fb4476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.804754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdba2-c782-4c0d-add9-913eb0fb4476 admin admin] PATH_INFO: `/v3/projects/8023dbba23df4032b62bf950b230ac9d/users/924b928a5d5a49088892cae2b11a9a1a/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.821806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bdba2-c782-4c0d-add9-913eb0fb4476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8023dbba23df4032b62bf950b230ac9d, user_id=924b928a5d5a49088892cae2b11a9a1a, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.824614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bdba2-c782-4c0d-add9-913eb0fb4476 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.842559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 965/1924] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:07 2022] PUT /identity/v3/projects/8023dbba23df4032b62bf950b230ac9d/users/924b928a5d5a49088892cae2b11a9a1a/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:07.843289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bdba2-c782-4c0d-add9-913eb0fb4476 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.845541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-589bdba2-c782-4c0d-add9-913eb0fb4476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:07.849013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de903-dbcb-4e1e-9346-224cb118e9bc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.885302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:07.917282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da88dc-3b87-4669-ab95-e67589abdd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.917838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da88dc-3b87-4669-ab95-e67589abdd8c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.918119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da88dc-3b87-4669-ab95-e67589abdd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.918392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da88dc-3b87-4669-ab95-e67589abdd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.919093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da88dc-3b87-4669-ab95-e67589abdd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.920673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da88dc-3b87-4669-ab95-e67589abdd8c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.929599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bdba2-c782-4c0d-add9-913eb0fb4476 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.935685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 960/1925] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:07.935685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da88dc-3b87-4669-ab95-e67589abdd8c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:07.935685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-10da88dc-3b87-4669-ab95-e67589abdd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:07.938116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.938801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.939081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.939353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] PATH_INFO: `/v3/users/bdeec0079ad544769c4c7dfa017f2dd8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.941197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdeec0079ad544769c4c7dfa017f2dd8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.943191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.968940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da88dc-3b87-4669-ab95-e67589abdd8c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:07.976307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c8c6-33bb-4e05-b058-051c56fe5983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:07.976938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c8c6-33bb-4e05-b058-051c56fe5983 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:07.977221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c8c6-33bb-4e05-b058-051c56fe5983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:07.977556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c8c6-33bb-4e05-b058-051c56fe5983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:07.978139 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912c8c6-33bb-4e05-b058-051c56fe5983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:07.981146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912c8c6-33bb-4e05-b058-051c56fe5983 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:07.998141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 961/1926] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:07.998141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c8c6-33bb-4e05-b058-051c56fe5983 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.012766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c8c6-33bb-4e05-b058-051c56fe5983 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.019523 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1cf48-7ce2-4a83-9bb8-78d0ff7c7170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.020497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1cf48-7ce2-4a83-9bb8-78d0ff7c7170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.020803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1cf48-7ce2-4a83-9bb8-78d0ff7c7170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.021047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1cf48-7ce2-4a83-9bb8-78d0ff7c7170 admin admin] PATH_INFO: `/v3/projects/89ff726ab6dc4905bbc8348e31d5fd98/users/6adbf10e70064457881bfa4bbcf93673/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.025615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:08.042519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1cf48-7ce2-4a83-9bb8-78d0ff7c7170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ff726ab6dc4905bbc8348e31d5fd98, user_id=6adbf10e70064457881bfa4bbcf93673, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.043278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdeec0079ad544769c4c7dfa017f2dd8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.046085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1cf48-7ce2-4a83-9bb8-78d0ff7c7170 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.060100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdeec0079ad544769c4c7dfa017f2dd8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.061128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 962/1927] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:07 2022] PUT /identity/v3/projects/89ff726ab6dc4905bbc8348e31d5fd98/users/6adbf10e70064457881bfa4bbcf93673/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:08.062203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1cf48-7ce2-4a83-9bb8-78d0ff7c7170 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.076202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdeec0079ad544769c4c7dfa017f2dd8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.089443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdeec0079ad544769c4c7dfa017f2dd8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.090101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdeec0079ad544769c4c7dfa017f2dd8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.098289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 966/1928] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:07 2022] DELETE /identity/v3/users/bdeec0079ad544769c4c7dfa017f2dd8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:08.099231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.100598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.151744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1cf48-7ce2-4a83-9bb8-78d0ff7c7170 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.186403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46235cc-7772-43c9-b8b5-52c05fb3a72f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.192946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa30d4-6e0f-456d-b9e7-9499cce6180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.194004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa30d4-6e0f-456d-b9e7-9499cce6180e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.194004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa30d4-6e0f-456d-b9e7-9499cce6180e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.194314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa30d4-6e0f-456d-b9e7-9499cce6180e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.195048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa30d4-6e0f-456d-b9e7-9499cce6180e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.205897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa30d4-6e0f-456d-b9e7-9499cce6180e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.223711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 967/1929] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:08.224593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa30d4-6e0f-456d-b9e7-9499cce6180e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.235116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa30d4-6e0f-456d-b9e7-9499cce6180e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.236895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243e3b0-167f-46c6-9c06-30481e2b7574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.238010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243e3b0-167f-46c6-9c06-30481e2b7574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.238471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243e3b0-167f-46c6-9c06-30481e2b7574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.238960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243e3b0-167f-46c6-9c06-30481e2b7574 admin admin] PATH_INFO: `/v3/projects/8023dbba23df4032b62bf950b230ac9d/users/924b928a5d5a49088892cae2b11a9a1a/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.240431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625998cf-9df5-46ea-bc78-50c70d4c814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.241062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625998cf-9df5-46ea-bc78-50c70d4c814c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.241359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625998cf-9df5-46ea-bc78-50c70d4c814c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.241639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625998cf-9df5-46ea-bc78-50c70d4c814c admin admin] PATH_INFO: `/v3/projects/89ff726ab6dc4905bbc8348e31d5fd98/users/6adbf10e70064457881bfa4bbcf93673/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.242388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243e3b0-167f-46c6-9c06-30481e2b7574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8023dbba23df4032b62bf950b230ac9d, user_id=924b928a5d5a49088892cae2b11a9a1a, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.245093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625998cf-9df5-46ea-bc78-50c70d4c814c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ff726ab6dc4905bbc8348e31d5fd98, user_id=6adbf10e70064457881bfa4bbcf93673, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.245428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243e3b0-167f-46c6-9c06-30481e2b7574 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.248215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625998cf-9df5-46ea-bc78-50c70d4c814c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.266747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 963/1930] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:08 2022] PUT /identity/v3/projects/8023dbba23df4032b62bf950b230ac9d/users/924b928a5d5a49088892cae2b11a9a1a/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:08.271986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 968/1931] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:08 2022] PUT /identity/v3/projects/89ff726ab6dc4905bbc8348e31d5fd98/users/6adbf10e70064457881bfa4bbcf93673/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:08.273953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdb890-7df1-46b6-9b4b-8fd188de848f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.274249 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdb890-7df1-46b6-9b4b-8fd188de848f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.274525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdb890-7df1-46b6-9b4b-8fd188de848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.285218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f09411-909a-45ea-9d93-26d738d692f1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.285218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f09411-909a-45ea-9d93-26d738d692f1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.285419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f09411-909a-45ea-9d93-26d738d692f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.311718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-98bdb890-7df1-46b6-9b4b-8fd188de848f None None] MFA Rules not processed for user `924b928a5d5a49088892cae2b11a9a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:08.312923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-98bdb890-7df1-46b6-9b4b-8fd188de848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.329808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-42f09411-909a-45ea-9d93-26d738d692f1 None None] MFA Rules not processed for user `6adbf10e70064457881bfa4bbcf93673`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:08.336720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-42f09411-909a-45ea-9d93-26d738d692f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.368398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:08.455393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 964/1932] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:08.456998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdb890-7df1-46b6-9b4b-8fd188de848f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.458807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-98bdb890-7df1-46b6-9b4b-8fd188de848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.470291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 969/1933] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:08.470291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f09411-909a-45ea-9d93-26d738d692f1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.481945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-42f09411-909a-45ea-9d93-26d738d692f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.482088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:08.543433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdb890-7df1-46b6-9b4b-8fd188de848f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.549944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.550822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.551105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.551377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] PATH_INFO: `/v3/projects/f13214f0d6534d90a5fbe335724ee801` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.551575 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f09411-909a-45ea-9d93-26d738d692f1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.554497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f13214f0d6534d90a5fbe335724ee801)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.555264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd1064-6867-4eda-878f-7693987e1c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.555876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd1064-6867-4eda-878f-7693987e1c06 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.556162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd1064-6867-4eda-878f-7693987e1c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.556439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd1064-6867-4eda-878f-7693987e1c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.556538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.567776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd1064-6867-4eda-878f-7693987e1c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.569238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd1064-6867-4eda-878f-7693987e1c06 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.581018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 970/1934] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:08.581936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd1064-6867-4eda-878f-7693987e1c06 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.584524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aefd1064-6867-4eda-878f-7693987e1c06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.600062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd1064-6867-4eda-878f-7693987e1c06 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.624844 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f13214f0d6534d90a5fbe335724ee801', 'request_id': 'req-3e14f42a-ef16-42f4-b317-01355f8ecfe7'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.635511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f13214f0d6534d90a5fbe335724ee801', 'request_id': 'req-3e14f42a-ef16-42f4-b317-01355f8ecfe7'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.645768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f13214f0d6534d90a5fbe335724ee801', 'request_id': 'req-3e14f42a-ef16-42f4-b317-01355f8ecfe7'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.664543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d7baf-40a2-444a-9515-2fe7a5170abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.665182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d7baf-40a2-444a-9515-2fe7a5170abb service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.665468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d7baf-40a2-444a-9515-2fe7a5170abb service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.665749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d7baf-40a2-444a-9515-2fe7a5170abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.668108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e89d7baf-40a2-444a-9515-2fe7a5170abb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.675033 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] The token cache is being invalidate because project f13214f0d6534d90a5fbe335724ee801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:08.675551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.676574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3e14f42a-ef16-42f4-b317-01355f8ecfe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:08.678709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 965/1935] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:08 2022] DELETE /identity/v3/projects/f13214f0d6534d90a5fbe335724ee801 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:08.683459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11badf2-31f0-4350-a01e-2ab3a0061be7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.684022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11badf2-31f0-4350-a01e-2ab3a0061be7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.684982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11badf2-31f0-4350-a01e-2ab3a0061be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.720379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e11badf2-31f0-4350-a01e-2ab3a0061be7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:08.722150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e11badf2-31f0-4350-a01e-2ab3a0061be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.766409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d7baf-40a2-444a-9515-2fe7a5170abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.768345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d7baf-40a2-444a-9515-2fe7a5170abb service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.779776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 971/1936] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:08.780755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d7baf-40a2-444a-9515-2fe7a5170abb service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.790282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d7baf-40a2-444a-9515-2fe7a5170abb service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.794868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe7ed5-32cf-4da0-b8be-7c65caf1556f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.795622 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe7ed5-32cf-4da0-b8be-7c65caf1556f service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.795982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe7ed5-32cf-4da0-b8be-7c65caf1556f service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.796374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe7ed5-32cf-4da0-b8be-7c65caf1556f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.800314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00fe7ed5-32cf-4da0-b8be-7c65caf1556f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.813063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 966/1937] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:08.813262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:08.815674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6809d83-74a7-4765-b3a7-0909631c9f77 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.817137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6809d83-74a7-4765-b3a7-0909631c9f77 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.817507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6809d83-74a7-4765-b3a7-0909631c9f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.842411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d6809d83-74a7-4765-b3a7-0909631c9f77 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:08.843696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d6809d83-74a7-4765-b3a7-0909631c9f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:08.856672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 967/1938] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:08.862710 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6809d83-74a7-4765-b3a7-0909631c9f77 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.874770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6809d83-74a7-4765-b3a7-0909631c9f77 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.880161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe7ed5-32cf-4da0-b8be-7c65caf1556f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.881637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe7ed5-32cf-4da0-b8be-7c65caf1556f service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.881953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80eeb-0dc0-4485-87fe-7aed3a10d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.882570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80eeb-0dc0-4485-87fe-7aed3a10d29e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.882882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80eeb-0dc0-4485-87fe-7aed3a10d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.883153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80eeb-0dc0-4485-87fe-7aed3a10d29e admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.883806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80eeb-0dc0-4485-87fe-7aed3a10d29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:08.884109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80eeb-0dc0-4485-87fe-7aed3a10d29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.885716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80eeb-0dc0-4485-87fe-7aed3a10d29e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.892268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 972/1939] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:08.901617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 968/1940] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:35:08.906478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe7ed5-32cf-4da0-b8be-7c65caf1556f service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.920574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe7ed5-32cf-4da0-b8be-7c65caf1556f service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:08.928125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c50ac-a61a-4d13-9697-f428293e8cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:08.928873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c50ac-a61a-4d13-9697-f428293e8cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:08.929262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c50ac-a61a-4d13-9697-f428293e8cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:08.929480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c50ac-a61a-4d13-9697-f428293e8cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:08.930129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c50ac-a61a-4d13-9697-f428293e8cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:08.932910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c50ac-a61a-4d13-9697-f428293e8cb8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:08.973504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 973/1941] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:08 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:08.976929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80eeb-0dc0-4485-87fe-7aed3a10d29e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:08.988403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80eeb-0dc0-4485-87fe-7aed3a10d29e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:09.063564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:09.160645 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374d9ff-3076-4b78-8e01-844de5c11a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:09.161350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374d9ff-3076-4b78-8e01-844de5c11a17 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:09.161825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374d9ff-3076-4b78-8e01-844de5c11a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:09.162087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374d9ff-3076-4b78-8e01-844de5c11a17 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:09.162932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374d9ff-3076-4b78-8e01-844de5c11a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:09.165196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374d9ff-3076-4b78-8e01-844de5c11a17 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:09.219121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 969/1942] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:08 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:09.225300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c50ac-a61a-4d13-9697-f428293e8cb8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:09.242821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c50ac-a61a-4d13-9697-f428293e8cb8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:09.269254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef1007-c955-496c-bbdf-e99859f3ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:09.270728 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef1007-c955-496c-bbdf-e99859f3ff88 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:09.277120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef1007-c955-496c-bbdf-e99859f3ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:09.278398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef1007-c955-496c-bbdf-e99859f3ff88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:09.279364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef1007-c955-496c-bbdf-e99859f3ff88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:09.281406 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef1007-c955-496c-bbdf-e99859f3ff88 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:09.296305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 974/1943] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:09.300718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374d9ff-3076-4b78-8e01-844de5c11a17 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:09.316763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374d9ff-3076-4b78-8e01-844de5c11a17 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:09.328651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c69a73-ab36-466e-9eed-32e70311e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:09.329232 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c69a73-ab36-466e-9eed-32e70311e751 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:09.329545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c69a73-ab36-466e-9eed-32e70311e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:09.329808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c69a73-ab36-466e-9eed-32e70311e751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:09.331012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c69a73-ab36-466e-9eed-32e70311e751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:09.332746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c69a73-ab36-466e-9eed-32e70311e751 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:09.350585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 970/1944] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:09.351519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef1007-c955-496c-bbdf-e99859f3ff88 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:09.375895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef1007-c955-496c-bbdf-e99859f3ff88 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:09.382993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0beecf-bf0b-4462-bd08-18524158c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:09.383866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0beecf-bf0b-4462-bd08-18524158c539 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:09.384199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0beecf-bf0b-4462-bd08-18524158c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:09.384410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0beecf-bf0b-4462-bd08-18524158c539 admin admin] PATH_INFO: `/v3/projects/3963eba1332d41cf868c5024c356ed0e/users/d7034fa2ba2f4ba78763b839d44e7a11/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:09.411127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0beecf-bf0b-4462-bd08-18524158c539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3963eba1332d41cf868c5024c356ed0e, user_id=d7034fa2ba2f4ba78763b839d44e7a11, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:09.419380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0beecf-bf0b-4462-bd08-18524158c539 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:09.442018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 975/1945] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:09 2022] PUT /identity/v3/projects/3963eba1332d41cf868c5024c356ed0e/users/d7034fa2ba2f4ba78763b839d44e7a11/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:09.453378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd5404-3122-4bd5-bc17-19493b7e8580 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:09.453667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd5404-3122-4bd5-bc17-19493b7e8580 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:09.453947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd5404-3122-4bd5-bc17-19493b7e8580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:09.527104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-bbfd5404-3122-4bd5-bc17-19493b7e8580 None None] MFA Rules not processed for user `d7034fa2ba2f4ba78763b839d44e7a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:09.529317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bbfd5404-3122-4bd5-bc17-19493b7e8580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:09.667162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 971/1946] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:09.672082 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0beecf-bf0b-4462-bd08-18524158c539 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:09.771448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0beecf-bf0b-4462-bd08-18524158c539 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:09.779009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116015c-1f1a-4008-944c-3b7c5936f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:09.779718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116015c-1f1a-4008-944c-3b7c5936f420 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:09.780121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116015c-1f1a-4008-944c-3b7c5936f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:09.780465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116015c-1f1a-4008-944c-3b7c5936f420 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:09.781221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116015c-1f1a-4008-944c-3b7c5936f420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:09.783738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116015c-1f1a-4008-944c-3b7c5936f420 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:09.819804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 976/1947] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:09 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:09.825272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd5404-3122-4bd5-bc17-19493b7e8580 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:09.838873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd5404-3122-4bd5-bc17-19493b7e8580 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:09.913895 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4b18a-235d-4c8a-9160-4acea6c18ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:09.914617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4b18a-235d-4c8a-9160-4acea6c18ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:09.915389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4b18a-235d-4c8a-9160-4acea6c18ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:09.915737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4b18a-235d-4c8a-9160-4acea6c18ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:09.916843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4b18a-235d-4c8a-9160-4acea6c18ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:09.919207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4b18a-235d-4c8a-9160-4acea6c18ae1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:09.952919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 972/1948] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:09 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:09.954272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116015c-1f1a-4008-944c-3b7c5936f420 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:09.968986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116015c-1f1a-4008-944c-3b7c5936f420 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:09.977327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa23fb7-9912-4b40-8645-bfd9f4412e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:09.985219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23fb7-9912-4b40-8645-bfd9f4412e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:09.985219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23fb7-9912-4b40-8645-bfd9f4412e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:09.985219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23fb7-9912-4b40-8645-bfd9f4412e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:09.985219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa23fb7-9912-4b40-8645-bfd9f4412e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:09.985219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa23fb7-9912-4b40-8645-bfd9f4412e5d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:09.996067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 977/1949] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:10.000787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4b18a-235d-4c8a-9160-4acea6c18ae1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:10.012643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4b18a-235d-4c8a-9160-4acea6c18ae1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:10.017479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50c6b5-6d9b-43c6-a02f-c402224d5c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:10.018395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50c6b5-6d9b-43c6-a02f-c402224d5c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:10.018751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50c6b5-6d9b-43c6-a02f-c402224d5c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:10.019013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50c6b5-6d9b-43c6-a02f-c402224d5c34 admin admin] PATH_INFO: `/v3/projects/4f0221198bff428ab92eb2c740c66bb8/users/47d8d003120148caadc195d4835473e6/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:10.035142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50c6b5-6d9b-43c6-a02f-c402224d5c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0221198bff428ab92eb2c740c66bb8, user_id=47d8d003120148caadc195d4835473e6, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:10.038084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50c6b5-6d9b-43c6-a02f-c402224d5c34 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:10.041658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:10.056043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 973/1950] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:09 2022] PUT /identity/v3/projects/4f0221198bff428ab92eb2c740c66bb8/users/47d8d003120148caadc195d4835473e6/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:10.059823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa23fb7-9912-4b40-8645-bfd9f4412e5d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:10.071699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa23fb7-9912-4b40-8645-bfd9f4412e5d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:10.106129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:10.148862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fa4e1-75aa-42b3-ada7-722a4a7caa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:10.149484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa4e1-75aa-42b3-ada7-722a4a7caa14 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:10.149771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa4e1-75aa-42b3-ada7-722a4a7caa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:10.150038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa4e1-75aa-42b3-ada7-722a4a7caa14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:10.150703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fa4e1-75aa-42b3-ada7-722a4a7caa14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:10.152309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fa4e1-75aa-42b3-ada7-722a4a7caa14 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:10.165531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 978/1951] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:10.167071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50c6b5-6d9b-43c6-a02f-c402224d5c34 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:10.181044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50c6b5-6d9b-43c6-a02f-c402224d5c34 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:10.185852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71a617-8d49-4da0-a51a-dfde51b2e6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:10.186564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71a617-8d49-4da0-a51a-dfde51b2e6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:10.186950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71a617-8d49-4da0-a51a-dfde51b2e6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:10.187229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71a617-8d49-4da0-a51a-dfde51b2e6e0 admin admin] PATH_INFO: `/v3/projects/4f0221198bff428ab92eb2c740c66bb8/users/47d8d003120148caadc195d4835473e6/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:10.189133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71a617-8d49-4da0-a51a-dfde51b2e6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0221198bff428ab92eb2c740c66bb8, user_id=47d8d003120148caadc195d4835473e6, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:10.192434 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71a617-8d49-4da0-a51a-dfde51b2e6e0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:10.203128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 974/1952] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:10 2022] PUT /identity/v3/projects/4f0221198bff428ab92eb2c740c66bb8/users/47d8d003120148caadc195d4835473e6/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:10.213988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14357911-b511-42c2-bc00-ddd1fc13de48 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:10.214279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14357911-b511-42c2-bc00-ddd1fc13de48 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:10.214581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14357911-b511-42c2-bc00-ddd1fc13de48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:10.244429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-14357911-b511-42c2-bc00-ddd1fc13de48 None None] MFA Rules not processed for user `47d8d003120148caadc195d4835473e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:10.245693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14357911-b511-42c2-bc00-ddd1fc13de48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:10.325529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 979/1953] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:10.360771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71a617-8d49-4da0-a51a-dfde51b2e6e0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:10.373643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ad71a617-8d49-4da0-a51a-dfde51b2e6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:10.448825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71a617-8d49-4da0-a51a-dfde51b2e6e0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:10.453941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77640c5-a47a-41a5-969f-219ef0fc2b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:10.454847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77640c5-a47a-41a5-969f-219ef0fc2b50 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:10.456039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77640c5-a47a-41a5-969f-219ef0fc2b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:10.456948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77640c5-a47a-41a5-969f-219ef0fc2b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:10.469053 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77640c5-a47a-41a5-969f-219ef0fc2b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:10.471900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77640c5-a47a-41a5-969f-219ef0fc2b50 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:10.485848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 975/1954] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:10.783867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14357911-b511-42c2-bc00-ddd1fc13de48 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:10.789749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14357911-b511-42c2-bc00-ddd1fc13de48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:10.806322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14357911-b511-42c2-bc00-ddd1fc13de48 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:10.810190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2345f8-4cfa-46ab-850f-133dd3e15c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:10.810838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2345f8-4cfa-46ab-850f-133dd3e15c7f service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:10.811216 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2345f8-4cfa-46ab-850f-133dd3e15c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:10.811549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2345f8-4cfa-46ab-850f-133dd3e15c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:10.813215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4e2345f8-4cfa-46ab-850f-133dd3e15c7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:10.898114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2345f8-4cfa-46ab-850f-133dd3e15c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:10.899715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2345f8-4cfa-46ab-850f-133dd3e15c7f service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:10.911895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 980/1955] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:11.727471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77640c5-a47a-41a5-969f-219ef0fc2b50 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:11.750914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2345f8-4cfa-46ab-850f-133dd3e15c7f service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:11.766381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2345f8-4cfa-46ab-850f-133dd3e15c7f service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:11.773849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddb6c6-e913-4f01-8778-9cfe148b34a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:11.774478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddb6c6-e913-4f01-8778-9cfe148b34a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:11.774806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddb6c6-e913-4f01-8778-9cfe148b34a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:11.775969 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddb6c6-e913-4f01-8778-9cfe148b34a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:11.779739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-48ddb6c6-e913-4f01-8778-9cfe148b34a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:11.822588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77640c5-a47a-41a5-969f-219ef0fc2b50 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:11.831658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:11.833297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:11.833781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:11.834296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] PATH_INFO: `/v3/users/d7034fa2ba2f4ba78763b839d44e7a11` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:11.836367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7034fa2ba2f4ba78763b839d44e7a11)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:11.839276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:11.839842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:11.860926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddb6c6-e913-4f01-8778-9cfe148b34a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:11.862572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddb6c6-e913-4f01-8778-9cfe148b34a5 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:11.874205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 981/1956] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:11.915294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7034fa2ba2f4ba78763b839d44e7a11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:11.928846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7034fa2ba2f4ba78763b839d44e7a11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:11.929918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7034fa2ba2f4ba78763b839d44e7a11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:11.953273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7034fa2ba2f4ba78763b839d44e7a11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:11.972566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7034fa2ba2f4ba78763b839d44e7a11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:11.988339 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 976/1957] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:11 2022] DELETE /identity/v3/users/d7034fa2ba2f4ba78763b839d44e7a11 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:11.995692 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809943-bb65-4b21-b47d-840b327b2f85 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:11.996590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809943-bb65-4b21-b47d-840b327b2f85 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:11.996888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809943-bb65-4b21-b47d-840b327b2f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:12.043771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-06809943-bb65-4b21-b47d-840b327b2f85 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:12.045203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-06809943-bb65-4b21-b47d-840b327b2f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:12.134763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 982/1958] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:12.153201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:12.156080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:12.166082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:12.264875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69f00-cb17-4403-a11a-bdec4575346a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:12.269612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06358d-dc1d-4b8b-929d-c8f88d10ad87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:12.270307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06358d-dc1d-4b8b-929d-c8f88d10ad87 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:12.274086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06358d-dc1d-4b8b-929d-c8f88d10ad87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:12.274371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06358d-dc1d-4b8b-929d-c8f88d10ad87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:12.285857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06358d-dc1d-4b8b-929d-c8f88d10ad87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:12.287553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06358d-dc1d-4b8b-929d-c8f88d10ad87 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:12.306539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 977/1959] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:12.722638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809943-bb65-4b21-b47d-840b327b2f85 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:12.724553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-06809943-bb65-4b21-b47d-840b327b2f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:12.741350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809943-bb65-4b21-b47d-840b327b2f85 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:12.758660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:12.759647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:12.760176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:12.760561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] PATH_INFO: `/v3/projects/3963eba1332d41cf868c5024c356ed0e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:12.762091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3963eba1332d41cf868c5024c356ed0e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:12.764683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:12.798251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06358d-dc1d-4b8b-929d-c8f88d10ad87 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:12.801337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1e06358d-dc1d-4b8b-929d-c8f88d10ad87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:12.838822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06358d-dc1d-4b8b-929d-c8f88d10ad87 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:12.844309 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:12.845188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:12.846221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:12.847002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] PATH_INFO: `/v3/users/da32656d22024940938bcd05cf039166` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:12.848389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da32656d22024940938bcd05cf039166)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:12.850560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:12.862497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3963eba1332d41cf868c5024c356ed0e', 'request_id': 'req-56261ff9-43fc-404a-8605-9147ae79047e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.874013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3963eba1332d41cf868c5024c356ed0e', 'request_id': 'req-56261ff9-43fc-404a-8605-9147ae79047e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.882240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3963eba1332d41cf868c5024c356ed0e', 'request_id': 'req-56261ff9-43fc-404a-8605-9147ae79047e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.899813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] The token cache is being invalidate because project 3963eba1332d41cf868c5024c356ed0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:12.902013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.903778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.907419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 983/1960] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:12 2022] DELETE /identity/v3/projects/3963eba1332d41cf868c5024c356ed0e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:12.911529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:12.914765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:12.926547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da32656d22024940938bcd05cf039166'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.941035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da32656d22024940938bcd05cf039166'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.941926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da32656d22024940938bcd05cf039166'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.963920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da32656d22024940938bcd05cf039166'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.976816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-da9112cf-b67c-4a9e-a488-dc4ffc5187b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da32656d22024940938bcd05cf039166'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:12.988405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 978/1961] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:12 2022] DELETE /identity/v3/users/da32656d22024940938bcd05cf039166 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:12.995122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f336-236d-450f-be50-0aacf63f19eb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:12.996305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f336-236d-450f-be50-0aacf63f19eb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:12.997695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f336-236d-450f-be50-0aacf63f19eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:13.022617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56261ff9-43fc-404a-8605-9147ae79047e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:13.037458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:13.056644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8f48f336-236d-450f-be50-0aacf63f19eb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:13.059290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8f48f336-236d-450f-be50-0aacf63f19eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:13.171016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:13.171986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:13.172440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:13.172886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] PATH_INFO: `/v3/users/47d8d003120148caadc195d4835473e6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:13.179602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d8d003120148caadc195d4835473e6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:13.182152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:13.291510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d8d003120148caadc195d4835473e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:13.305553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 979/1962] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:13.324957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d8d003120148caadc195d4835473e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:13.325454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48f336-236d-450f-be50-0aacf63f19eb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:13.327167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8f48f336-236d-450f-be50-0aacf63f19eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:13.342857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d8d003120148caadc195d4835473e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:13.364448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d8d003120148caadc195d4835473e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:13.365338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d8d003120148caadc195d4835473e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:13.377074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:13.378815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 984/1963] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:12 2022] DELETE /identity/v3/users/47d8d003120148caadc195d4835473e6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:13.480160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48f336-236d-450f-be50-0aacf63f19eb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:13.568615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263dc84-8208-45e2-8c31-fcb0a3e7ad98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:13.569676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263dc84-8208-45e2-8c31-fcb0a3e7ad98 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:13.570212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263dc84-8208-45e2-8c31-fcb0a3e7ad98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:13.570766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263dc84-8208-45e2-8c31-fcb0a3e7ad98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:13.572994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7263dc84-8208-45e2-8c31-fcb0a3e7ad98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:13.698528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263dc84-8208-45e2-8c31-fcb0a3e7ad98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:13.700011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263dc84-8208-45e2-8c31-fcb0a3e7ad98 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:13.725296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 980/1964] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:13.908811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:13.910611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:13.925310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcbdb3-97c1-4317-89b7-d54572bfd352 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:13.930623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:13.931307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:13.932084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:13.932364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] PATH_INFO: `/v3/projects/4f0221198bff428ab92eb2c740c66bb8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:13.933869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0221198bff428ab92eb2c740c66bb8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:13.935890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.009483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0221198bff428ab92eb2c740c66bb8', 'request_id': 'req-9d26db6d-e5a8-4560-8bc0-47ca590a0691'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.023109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0221198bff428ab92eb2c740c66bb8', 'request_id': 'req-9d26db6d-e5a8-4560-8bc0-47ca590a0691'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.028970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0221198bff428ab92eb2c740c66bb8', 'request_id': 'req-9d26db6d-e5a8-4560-8bc0-47ca590a0691'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.066437 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] The token cache is being invalidate because project 4f0221198bff428ab92eb2c740c66bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:14.067018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.067833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d26db6d-e5a8-4560-8bc0-47ca590a0691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.069511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 985/1965] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:13 2022] DELETE /identity/v3/projects/4f0221198bff428ab92eb2c740c66bb8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:14.074473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05243c26-68af-4390-8799-41f7d569867c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.074966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05243c26-68af-4390-8799-41f7d569867c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.075060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05243c26-68af-4390-8799-41f7d569867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.107552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-05243c26-68af-4390-8799-41f7d569867c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:14.109217 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-05243c26-68af-4390-8799-41f7d569867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:14.182473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 981/1966] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:14.191902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e745a-6dd4-47c5-9ed2-60a64a26fe94 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.192345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e745a-6dd4-47c5-9ed2-60a64a26fe94 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.192712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e745a-6dd4-47c5-9ed2-60a64a26fe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.209061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05243c26-68af-4390-8799-41f7d569867c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.210842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-05243c26-68af-4390-8799-41f7d569867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:14.215091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d68e745a-6dd4-47c5-9ed2-60a64a26fe94 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:14.216367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d68e745a-6dd4-47c5-9ed2-60a64a26fe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:14.225372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 986/1967] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:14.227811 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05243c26-68af-4390-8799-41f7d569867c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.230557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e745a-6dd4-47c5-9ed2-60a64a26fe94 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.232941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.234495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.235100 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.235385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] PATH_INFO: `/v3/projects/93b359b3c9104916a1ebf16e245be3c7` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.237465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b359b3c9104916a1ebf16e245be3c7)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.239759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.242454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e745a-6dd4-47c5-9ed2-60a64a26fe94 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.247405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c19dd-24a1-43a4-9174-a95c366d5c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.248033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c19dd-24a1-43a4-9174-a95c366d5c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.248320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c19dd-24a1-43a4-9174-a95c366d5c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.248719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c19dd-24a1-43a4-9174-a95c366d5c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.249392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c19dd-24a1-43a4-9174-a95c366d5c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:14.249699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c19dd-24a1-43a4-9174-a95c366d5c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.252389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c19dd-24a1-43a4-9174-a95c366d5c55 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.255314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:14.269490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 987/1968] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:35:14.272868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:14.273074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c19dd-24a1-43a4-9174-a95c366d5c55 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.284814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c19dd-24a1-43a4-9174-a95c366d5c55 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.295067 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b359b3c9104916a1ebf16e245be3c7', 'request_id': 'req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.302016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b359b3c9104916a1ebf16e245be3c7', 'request_id': 'req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.308360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b359b3c9104916a1ebf16e245be3c7', 'request_id': 'req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.326570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] The token cache is being invalidate because project 93b359b3c9104916a1ebf16e245be3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:14.326897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.327579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.329438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 982/1969] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:14 2022] DELETE /identity/v3/projects/93b359b3c9104916a1ebf16e245be3c7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:14.334211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.335968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:14.364876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb88772-1af4-4513-9abf-c3dae2ce617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.365498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb88772-1af4-4513-9abf-c3dae2ce617b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.365778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb88772-1af4-4513-9abf-c3dae2ce617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.366135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb88772-1af4-4513-9abf-c3dae2ce617b admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.367192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb88772-1af4-4513-9abf-c3dae2ce617b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.370246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb88772-1af4-4513-9abf-c3dae2ce617b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.405815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 988/1970] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:14 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:14.410084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb88772-1af4-4513-9abf-c3dae2ce617b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.411938 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-adb88772-1af4-4513-9abf-c3dae2ce617b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:14.426966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb7ed-f41e-4369-be4a-f8bccf4fc9bf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.493752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb88772-1af4-4513-9abf-c3dae2ce617b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.499359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277481ff-adc5-485f-b763-695714f0b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.499989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277481ff-adc5-485f-b763-695714f0b0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.500274 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277481ff-adc5-485f-b763-695714f0b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.500553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277481ff-adc5-485f-b763-695714f0b0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.501227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277481ff-adc5-485f-b763-695714f0b0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.504046 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277481ff-adc5-485f-b763-695714f0b0d4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.523802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.526799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.527219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.527657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] PATH_INFO: `/v3/users/c6525e61c38f4361b341a1689baee414` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.530784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 989/1971] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:14 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:14.530944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6525e61c38f4361b341a1689baee414)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.531786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.532569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277481ff-adc5-485f-b763-695714f0b0d4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.545511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277481ff-adc5-485f-b763-695714f0b0d4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.551417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b001d7-5600-4dad-a1c1-e234ef8a4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.552030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b001d7-5600-4dad-a1c1-e234ef8a4120 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.552310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b001d7-5600-4dad-a1c1-e234ef8a4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.553034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b001d7-5600-4dad-a1c1-e234ef8a4120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.553345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b001d7-5600-4dad-a1c1-e234ef8a4120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.555163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b001d7-5600-4dad-a1c1-e234ef8a4120 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.569692 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 990/1972] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:14.571161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b001d7-5600-4dad-a1c1-e234ef8a4120 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.583315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b001d7-5600-4dad-a1c1-e234ef8a4120 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.589297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a12f-7fbd-46e2-8ac9-3d851e556dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.590204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a12f-7fbd-46e2-8ac9-3d851e556dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.590954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a12f-7fbd-46e2-8ac9-3d851e556dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.591243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a12f-7fbd-46e2-8ac9-3d851e556dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.592222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084a12f-7fbd-46e2-8ac9-3d851e556dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.594575 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084a12f-7fbd-46e2-8ac9-3d851e556dbf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.600950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6525e61c38f4361b341a1689baee414'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.610830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6525e61c38f4361b341a1689baee414'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.612337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6525e61c38f4361b341a1689baee414'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.613931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 991/1973] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:14.614627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a12f-7fbd-46e2-8ac9-3d851e556dbf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.617534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e084a12f-7fbd-46e2-8ac9-3d851e556dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:14.619680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:14.636173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6525e61c38f4361b341a1689baee414'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.637178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a12f-7fbd-46e2-8ac9-3d851e556dbf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.644438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee0a87-dd95-46a0-85c2-fb199ff3a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.645131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0a87-dd95-46a0-85c2-fb199ff3a42a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.645864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0a87-dd95-46a0-85c2-fb199ff3a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.645864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0a87-dd95-46a0-85c2-fb199ff3a42a admin admin] PATH_INFO: `/v3/projects/e58c9d87a1f248ed854bce556959d23e/users/93d8e07f563246d7b05cd45e0f6ae0cb/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.647811 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ebdb416-ba07-444b-ada8-60557a8d0485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6525e61c38f4361b341a1689baee414'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.674950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee0a87-dd95-46a0-85c2-fb199ff3a42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58c9d87a1f248ed854bce556959d23e, user_id=93d8e07f563246d7b05cd45e0f6ae0cb, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.675694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 983/1974] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:14 2022] DELETE /identity/v3/users/c6525e61c38f4361b341a1689baee414 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:14.675775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee0a87-dd95-46a0-85c2-fb199ff3a42a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.702754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 992/1975] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:14 2022] PUT /identity/v3/projects/e58c9d87a1f248ed854bce556959d23e/users/93d8e07f563246d7b05cd45e0f6ae0cb/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:14.710986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8312dc-f89b-458d-b863-08a3eb4a9fbd None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.710986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8312dc-f89b-458d-b863-08a3eb4a9fbd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.710986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8312dc-f89b-458d-b863-08a3eb4a9fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.759313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1b8312dc-f89b-458d-b863-08a3eb4a9fbd None None] MFA Rules not processed for user `93d8e07f563246d7b05cd45e0f6ae0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:14.760685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1b8312dc-f89b-458d-b863-08a3eb4a9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:14.875106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 984/1976] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:14.882535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee0a87-dd95-46a0-85c2-fb199ff3a42a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.884392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a2ee0a87-dd95-46a0-85c2-fb199ff3a42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:14.925215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:14.967464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee0a87-dd95-46a0-85c2-fb199ff3a42a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.972096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13088316-48fa-4c6a-bd8a-560c6a1e609b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.972719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13088316-48fa-4c6a-bd8a-560c6a1e609b service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.973012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13088316-48fa-4c6a-bd8a-560c6a1e609b service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.973269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13088316-48fa-4c6a-bd8a-560c6a1e609b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.982827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13088316-48fa-4c6a-bd8a-560c6a1e609b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.984630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13088316-48fa-4c6a-bd8a-560c6a1e609b service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.000024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 993/1977] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:15.136656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8312dc-f89b-458d-b863-08a3eb4a9fbd None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.138083 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1b8312dc-f89b-458d-b863-08a3eb4a9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:15.221518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8312dc-f89b-458d-b863-08a3eb4a9fbd None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.227728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.228606 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.229743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.230183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] PATH_INFO: `/v3/projects/2883f633282040bf817f898d6b4310d3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.231858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2883f633282040bf817f898d6b4310d3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.234265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.300711 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2883f633282040bf817f898d6b4310d3', 'request_id': 'req-872050d1-0c6b-4d69-87f8-ef6e16492e2e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:15.306964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2883f633282040bf817f898d6b4310d3', 'request_id': 'req-872050d1-0c6b-4d69-87f8-ef6e16492e2e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:15.312753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2883f633282040bf817f898d6b4310d3', 'request_id': 'req-872050d1-0c6b-4d69-87f8-ef6e16492e2e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:15.316419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:15.332240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] The token cache is being invalidate because project 2883f633282040bf817f898d6b4310d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:15.332797 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:15.333643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-872050d1-0c6b-4d69-87f8-ef6e16492e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:15.336968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 985/1978] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:15 2022] DELETE /identity/v3/projects/2883f633282040bf817f898d6b4310d3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:15.342753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d39a0-b3c5-4c49-b72b-aebba783e033 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.343292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d39a0-b3c5-4c49-b72b-aebba783e033 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.343720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d39a0-b3c5-4c49-b72b-aebba783e033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.365724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ea0d39a0-b3c5-4c49-b72b-aebba783e033 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:15.366964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ea0d39a0-b3c5-4c49-b72b-aebba783e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:15.443752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 994/1979] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:15.453091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634e8b5-34d4-4d24-ab2b-b800787b36f0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.453493 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634e8b5-34d4-4d24-ab2b-b800787b36f0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.453892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634e8b5-34d4-4d24-ab2b-b800787b36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.475532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1634e8b5-34d4-4d24-ab2b-b800787b36f0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:15.476851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1634e8b5-34d4-4d24-ab2b-b800787b36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:15.485420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 986/1980] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:15.489591 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d39a0-b3c5-4c49-b72b-aebba783e033 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.499738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d39a0-b3c5-4c49-b72b-aebba783e033 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.504507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46541715-ee79-40c9-bbc1-d61b152a1aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.505131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46541715-ee79-40c9-bbc1-d61b152a1aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.505419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46541715-ee79-40c9-bbc1-d61b152a1aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.505693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46541715-ee79-40c9-bbc1-d61b152a1aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.506352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46541715-ee79-40c9-bbc1-d61b152a1aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:15.506714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46541715-ee79-40c9-bbc1-d61b152a1aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.508307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46541715-ee79-40c9-bbc1-d61b152a1aa8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.521662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 995/1981] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:15.526082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634e8b5-34d4-4d24-ab2b-b800787b36f0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.543592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634e8b5-34d4-4d24-ab2b-b800787b36f0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.549875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a21c6-fe04-4c87-99cc-51a3284d686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.550517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a21c6-fe04-4c87-99cc-51a3284d686f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.551065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a21c6-fe04-4c87-99cc-51a3284d686f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.551465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a21c6-fe04-4c87-99cc-51a3284d686f admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.552113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a21c6-fe04-4c87-99cc-51a3284d686f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.554047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a21c6-fe04-4c87-99cc-51a3284d686f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.582021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 987/1982] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:15.586269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46541715-ee79-40c9-bbc1-d61b152a1aa8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.596961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46541715-ee79-40c9-bbc1-d61b152a1aa8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.664116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2d6d4-2ca6-4f59-8dbb-ea0769742bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.665856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d6d4-2ca6-4f59-8dbb-ea0769742bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.665856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d6d4-2ca6-4f59-8dbb-ea0769742bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.665856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d6d4-2ca6-4f59-8dbb-ea0769742bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.666144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2d6d4-2ca6-4f59-8dbb-ea0769742bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.668290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2d6d4-2ca6-4f59-8dbb-ea0769742bf4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.698415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 996/1983] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/users => generated 279 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:15.699701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a21c6-fe04-4c87-99cc-51a3284d686f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.716561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a21c6-fe04-4c87-99cc-51a3284d686f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.722769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db61053-2162-43d9-9407-b37cca3d822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.723660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db61053-2162-43d9-9407-b37cca3d822f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.723993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db61053-2162-43d9-9407-b37cca3d822f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.724301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db61053-2162-43d9-9407-b37cca3d822f admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.725002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db61053-2162-43d9-9407-b37cca3d822f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.726809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db61053-2162-43d9-9407-b37cca3d822f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.742719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 988/1984] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:15.744526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2d6d4-2ca6-4f59-8dbb-ea0769742bf4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.756214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2d6d4-2ca6-4f59-8dbb-ea0769742bf4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.760983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692a21e-fad6-47f5-8de7-4c82e616ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.761618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692a21e-fad6-47f5-8de7-4c82e616ac85 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.761887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692a21e-fad6-47f5-8de7-4c82e616ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.762166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692a21e-fad6-47f5-8de7-4c82e616ac85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.762853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692a21e-fad6-47f5-8de7-4c82e616ac85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.764481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692a21e-fad6-47f5-8de7-4c82e616ac85 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.778705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 997/1985] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:15.785910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db61053-2162-43d9-9407-b37cca3d822f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.796108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db61053-2162-43d9-9407-b37cca3d822f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.801261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3de6b-4dfe-4df4-b038-4f5bdf469eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.801928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3de6b-4dfe-4df4-b038-4f5bdf469eda admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.802210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3de6b-4dfe-4df4-b038-4f5bdf469eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.802490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3de6b-4dfe-4df4-b038-4f5bdf469eda admin admin] PATH_INFO: `/v3/projects/80ec3d7c3a54447d9202da589b6e8b10/users/5e934b39bac1433d9e687feb387c8583/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.818634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3de6b-4dfe-4df4-b038-4f5bdf469eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ec3d7c3a54447d9202da589b6e8b10, user_id=5e934b39bac1433d9e687feb387c8583, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.821340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3de6b-4dfe-4df4-b038-4f5bdf469eda admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.847313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 989/1986] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:15 2022] PUT /identity/v3/projects/80ec3d7c3a54447d9202da589b6e8b10/users/5e934b39bac1433d9e687feb387c8583/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:15.859230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b1f7-9280-4ccd-8c93-8d1006137ccc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.859624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b1f7-9280-4ccd-8c93-8d1006137ccc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.860017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b1f7-9280-4ccd-8c93-8d1006137ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.895496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b5e3b1f7-9280-4ccd-8c93-8d1006137ccc None None] MFA Rules not processed for user `5e934b39bac1433d9e687feb387c8583`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:15.896795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b5e3b1f7-9280-4ccd-8c93-8d1006137ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:15.923937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:15.966791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3de6b-4dfe-4df4-b038-4f5bdf469eda admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.969464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5ab3de6b-4dfe-4df4-b038-4f5bdf469eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:15.978021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 998/1987] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:15.982557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3b1f7-9280-4ccd-8c93-8d1006137ccc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.053892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3de6b-4dfe-4df4-b038-4f5bdf469eda admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.058252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3b1f7-9280-4ccd-8c93-8d1006137ccc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.059231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.060330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.060330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.060522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] PATH_INFO: `/v3/users/2a91b60282b2443a92d8df5d3088c84c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.061517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a91b60282b2443a92d8df5d3088c84c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.063503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.065134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17505199-f619-4fe5-8f6a-4047855e8bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.066407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505199-f619-4fe5-8f6a-4047855e8bca admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.067122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505199-f619-4fe5-8f6a-4047855e8bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.067352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505199-f619-4fe5-8f6a-4047855e8bca admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.069775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17505199-f619-4fe5-8f6a-4047855e8bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.071937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17505199-f619-4fe5-8f6a-4047855e8bca admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.121071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 999/1988] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/projects => generated 355 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:16.122607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17505199-f619-4fe5-8f6a-4047855e8bca admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.152081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a91b60282b2443a92d8df5d3088c84c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.162829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a91b60282b2443a92d8df5d3088c84c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.163728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a91b60282b2443a92d8df5d3088c84c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.182219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a91b60282b2443a92d8df5d3088c84c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.191577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b601f81-c732-456d-b1cd-69822abb3f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a91b60282b2443a92d8df5d3088c84c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.198820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 990/1989] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:15 2022] DELETE /identity/v3/users/2a91b60282b2443a92d8df5d3088c84c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:16.203538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d9363-5687-4d4e-8bb1-65c9a02f6331 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.203987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d9363-5687-4d4e-8bb1-65c9a02f6331 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.204453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d9363-5687-4d4e-8bb1-65c9a02f6331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.212689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17505199-f619-4fe5-8f6a-4047855e8bca admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.227036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d48d9363-5687-4d4e-8bb1-65c9a02f6331 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:16.228284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d48d9363-5687-4d4e-8bb1-65c9a02f6331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.234187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:16.286081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:16.295950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39fe0-ca50-4a17-bdf4-0c814b8c81bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.297062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39fe0-ca50-4a17-bdf4-0c814b8c81bb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.297304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39fe0-ca50-4a17-bdf4-0c814b8c81bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.298048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39fe0-ca50-4a17-bdf4-0c814b8c81bb admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.299440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e39fe0-ca50-4a17-bdf4-0c814b8c81bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.301592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e39fe0-ca50-4a17-bdf4-0c814b8c81bb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.329696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 991/1990] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:16.362326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1000/1991] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:16 2022] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:16.363587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d9363-5687-4d4e-8bb1-65c9a02f6331 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.365069 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d48d9363-5687-4d4e-8bb1-65c9a02f6331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.377363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39fe0-ca50-4a17-bdf4-0c814b8c81bb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.379025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d9363-5687-4d4e-8bb1-65c9a02f6331 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.380360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f6e39fe0-ca50-4a17-bdf4-0c814b8c81bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.385383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1704d-b5d6-444e-8009-a86353f9c039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.386165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1704d-b5d6-444e-8009-a86353f9c039 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.388423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1704d-b5d6-444e-8009-a86353f9c039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.388423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1704d-b5d6-444e-8009-a86353f9c039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.388423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1704d-b5d6-444e-8009-a86353f9c039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.389676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1704d-b5d6-444e-8009-a86353f9c039 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.410778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 992/1992] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:16.413333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1704d-b5d6-444e-8009-a86353f9c039 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.432673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1704d-b5d6-444e-8009-a86353f9c039 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.437719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883ec29-07bb-49c7-900e-c3de2fa2644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.438488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883ec29-07bb-49c7-900e-c3de2fa2644a admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.438902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883ec29-07bb-49c7-900e-c3de2fa2644a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.439807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883ec29-07bb-49c7-900e-c3de2fa2644a admin admin] PATH_INFO: `/v3/projects/1eaaa076244249399fd8c3c8f1964de5/users/d381c7272ba848b49e7eddbb97435181/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.467125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883ec29-07bb-49c7-900e-c3de2fa2644a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaaa076244249399fd8c3c8f1964de5, user_id=d381c7272ba848b49e7eddbb97435181, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.471143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883ec29-07bb-49c7-900e-c3de2fa2644a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.493695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39fe0-ca50-4a17-bdf4-0c814b8c81bb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.498777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 993/1993] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:16 2022] PUT /identity/v3/projects/1eaaa076244249399fd8c3c8f1964de5/users/d381c7272ba848b49e7eddbb97435181/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:16.498777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883ec29-07bb-49c7-900e-c3de2fa2644a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.499152 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d883ec29-07bb-49c7-900e-c3de2fa2644a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.578893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b080-370f-4ce2-b334-b9823ff8deba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.581279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b080-370f-4ce2-b334-b9823ff8deba service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.582107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b080-370f-4ce2-b334-b9823ff8deba service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.582874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b080-370f-4ce2-b334-b9823ff8deba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.598883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0b080-370f-4ce2-b334-b9823ff8deba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.601466 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0b080-370f-4ce2-b334-b9823ff8deba service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.613144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883ec29-07bb-49c7-900e-c3de2fa2644a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.619952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1001/1994] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:35:16.620825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b080-370f-4ce2-b334-b9823ff8deba service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.622277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.622950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.623233 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.623501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] PATH_INFO: `/v3/users/ff32f25e21e74be28846c22121057ed4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.624830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff32f25e21e74be28846c22121057ed4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.628350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.631129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b080-370f-4ce2-b334-b9823ff8deba service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.636247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cd7f3-142a-4189-a209-f5fe483b86f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.636863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd7f3-142a-4189-a209-f5fe483b86f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.637286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd7f3-142a-4189-a209-f5fe483b86f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.637528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd7f3-142a-4189-a209-f5fe483b86f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.638319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cd7f3-142a-4189-a209-f5fe483b86f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.640011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cd7f3-142a-4189-a209-f5fe483b86f2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.654708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1002/1995] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:16.659901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cd7f3-142a-4189-a209-f5fe483b86f2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.683307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cd7f3-142a-4189-a209-f5fe483b86f2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.689962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f30df-f963-4cc5-953d-8bb6af4a34ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.694298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f30df-f963-4cc5-953d-8bb6af4a34ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.694298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f30df-f963-4cc5-953d-8bb6af4a34ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.694298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f30df-f963-4cc5-953d-8bb6af4a34ea admin admin] PATH_INFO: `/v3/projects/1eaaa076244249399fd8c3c8f1964de5/users/d381c7272ba848b49e7eddbb97435181/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.696268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f30df-f963-4cc5-953d-8bb6af4a34ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaaa076244249399fd8c3c8f1964de5, user_id=d381c7272ba848b49e7eddbb97435181, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.700280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff32f25e21e74be28846c22121057ed4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.701943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f30df-f963-4cc5-953d-8bb6af4a34ea admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.710353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff32f25e21e74be28846c22121057ed4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.711522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff32f25e21e74be28846c22121057ed4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.718277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1003/1996] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:16 2022] PUT /identity/v3/projects/1eaaa076244249399fd8c3c8f1964de5/users/d381c7272ba848b49e7eddbb97435181/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:16.728502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff32f25e21e74be28846c22121057ed4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.730095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211e486-8f24-4522-abf6-47253f706da2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.730881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211e486-8f24-4522-abf6-47253f706da2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.731263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211e486-8f24-4522-abf6-47253f706da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.735115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:16.741521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c55bb96d-a8d3-4f42-9684-1363a4bc952d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff32f25e21e74be28846c22121057ed4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:16.758761 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 994/1997] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:16 2022] DELETE /identity/v3/users/ff32f25e21e74be28846c22121057ed4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:16.763780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e402-6222-46ad-bdda-65ab770fb3d3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.764248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e402-6222-46ad-bdda-65ab770fb3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.764823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e402-6222-46ad-bdda-65ab770fb3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.796412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-42b2e402-6222-46ad-bdda-65ab770fb3d3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:16.797879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c211e486-8f24-4522-abf6-47253f706da2 None None] MFA Rules not processed for user `d381c7272ba848b49e7eddbb97435181`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:16.798008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-42b2e402-6222-46ad-bdda-65ab770fb3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.804835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c211e486-8f24-4522-abf6-47253f706da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.886172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 995/1998] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:16.899511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2e402-6222-46ad-bdda-65ab770fb3d3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.900961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-42b2e402-6222-46ad-bdda-65ab770fb3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.902179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1004/1999] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:16.914342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211e486-8f24-4522-abf6-47253f706da2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.916047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c211e486-8f24-4522-abf6-47253f706da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.922594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:16.971718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2e402-6222-46ad-bdda-65ab770fb3d3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.977024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98521670-8630-47c8-9dbf-c0807e8d60d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.977024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98521670-8630-47c8-9dbf-c0807e8d60d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.977616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98521670-8630-47c8-9dbf-c0807e8d60d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.979734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98521670-8630-47c8-9dbf-c0807e8d60d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.982362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211e486-8f24-4522-abf6-47253f706da2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.986982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cbbd3-069a-4038-b3ac-eae91d2a65c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.987789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cbbd3-069a-4038-b3ac-eae91d2a65c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.988054 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cbbd3-069a-4038-b3ac-eae91d2a65c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.988417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cbbd3-069a-4038-b3ac-eae91d2a65c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.991493 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98521670-8630-47c8-9dbf-c0807e8d60d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.993104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98521670-8630-47c8-9dbf-c0807e8d60d2 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.998814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cbbd3-069a-4038-b3ac-eae91d2a65c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:17.000361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cbbd3-069a-4038-b3ac-eae91d2a65c0 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:17.005002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 996/2000] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:35:17.012092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1005/2001] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:16 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:35:17.097325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98521670-8630-47c8-9dbf-c0807e8d60d2 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:17.107415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98521670-8630-47c8-9dbf-c0807e8d60d2 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:17.113328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390961e3-800f-41ec-ac00-7a9dd1d3ca43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:17.114026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390961e3-800f-41ec-ac00-7a9dd1d3ca43 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:17.114379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390961e3-800f-41ec-ac00-7a9dd1d3ca43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:17.114746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390961e3-800f-41ec-ac00-7a9dd1d3ca43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:17.116765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-390961e3-800f-41ec-ac00-7a9dd1d3ca43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:17.194931 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390961e3-800f-41ec-ac00-7a9dd1d3ca43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:17.196508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390961e3-800f-41ec-ac00-7a9dd1d3ca43 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:17.208603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 997/2002] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:35:17.761264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cbbd3-069a-4038-b3ac-eae91d2a65c0 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:17.762808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3c2cbbd3-069a-4038-b3ac-eae91d2a65c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:17.796821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cbbd3-069a-4038-b3ac-eae91d2a65c0 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:17.810498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:17.811494 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:17.812065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:17.812271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] PATH_INFO: `/v3/projects/43cd69b3731f45a2a5feb6171b671faa` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:17.820323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43cd69b3731f45a2a5feb6171b671faa)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:17.824049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:17.894275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43cd69b3731f45a2a5feb6171b671faa', 'request_id': 'req-8dc87799-c5d7-4903-9c33-d71b8f8be848'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.904361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43cd69b3731f45a2a5feb6171b671faa', 'request_id': 'req-8dc87799-c5d7-4903-9c33-d71b8f8be848'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.914875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43cd69b3731f45a2a5feb6171b671faa', 'request_id': 'req-8dc87799-c5d7-4903-9c33-d71b8f8be848'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.934920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] The token cache is being invalidate because project 43cd69b3731f45a2a5feb6171b671faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:17.935643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.936897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.941582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1006/2003] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:17 2022] DELETE /identity/v3/projects/43cd69b3731f45a2a5feb6171b671faa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:17.944987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390961e3-800f-41ec-ac00-7a9dd1d3ca43 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:17.959339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:17.962614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:17.964787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390961e3-800f-41ec-ac00-7a9dd1d3ca43 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:18.051044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:18.089740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:18.090454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:18.090863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:18.091301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] PATH_INFO: `/v3/users/924b928a5d5a49088892cae2b11a9a1a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:18.092802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924b928a5d5a49088892cae2b11a9a1a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:18.095198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:18.098563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc87799-c5d7-4903-9c33-d71b8f8be848 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:18.105651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:18.106540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:18.106850 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:18.108112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] PATH_INFO: `/v3/projects/e73be1d5745a42b990d7d8dc7ca169fd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:18.109643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73be1d5745a42b990d7d8dc7ca169fd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:18.113105 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:18.188548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924b928a5d5a49088892cae2b11a9a1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.200808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924b928a5d5a49088892cae2b11a9a1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.201453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924b928a5d5a49088892cae2b11a9a1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.217995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:18.219318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924b928a5d5a49088892cae2b11a9a1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.231622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924b928a5d5a49088892cae2b11a9a1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.240226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73be1d5745a42b990d7d8dc7ca169fd', 'request_id': 'req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.248123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 998/2004] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:17 2022] DELETE /identity/v3/users/924b928a5d5a49088892cae2b11a9a1a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:18.257125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73be1d5745a42b990d7d8dc7ca169fd', 'request_id': 'req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.268733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73be1d5745a42b990d7d8dc7ca169fd', 'request_id': 'req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.284298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] The token cache is being invalidate because project e73be1d5745a42b990d7d8dc7ca169fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:18.284643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.285430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.287165 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1007/2005] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:17 2022] DELETE /identity/v3/projects/e73be1d5745a42b990d7d8dc7ca169fd => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:18.291943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:18.294139 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:18.401338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221637aa-30f2-42fa-8472-3fdd51eaca03 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:18.407918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:18.408633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:18.408914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:18.409208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] PATH_INFO: `/v3/users/cec02d954d264199a6e6343b7f141300` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:18.410391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec02d954d264199a6e6343b7f141300)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:18.412914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:18.510999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec02d954d264199a6e6343b7f141300'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.530290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec02d954d264199a6e6343b7f141300'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.531520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec02d954d264199a6e6343b7f141300'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.541553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:18.562253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec02d954d264199a6e6343b7f141300'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.585776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec02d954d264199a6e6343b7f141300'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.598738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 999/2006] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:18 2022] DELETE /identity/v3/users/cec02d954d264199a6e6343b7f141300 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:18.923439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:18.931321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:19.017320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:19.019063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:19.098672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe70bd5-a6c4-48af-98ef-bef8f21ff470 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:19.137667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076285a9-4f60-4d03-97db-c9fab87c0a8e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:19.143341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:19.144097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.144376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.144644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] PATH_INFO: `/v3/projects/25c1a22fa1af4ccfaa882e9be467bd23` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.146048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c1a22fa1af4ccfaa882e9be467bd23)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:19.148874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:19.181825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:19.182879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.183422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.183901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] PATH_INFO: `/v3/projects/8023dbba23df4032b62bf950b230ac9d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.185453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8023dbba23df4032b62bf950b230ac9d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:19.189114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:19.208956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c1a22fa1af4ccfaa882e9be467bd23', 'request_id': 'req-8b6d5344-45ee-4224-ae58-29c1d39b1aee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.215959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c1a22fa1af4ccfaa882e9be467bd23', 'request_id': 'req-8b6d5344-45ee-4224-ae58-29c1d39b1aee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.228783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c1a22fa1af4ccfaa882e9be467bd23', 'request_id': 'req-8b6d5344-45ee-4224-ae58-29c1d39b1aee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.249306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] The token cache is being invalidate because project 25c1a22fa1af4ccfaa882e9be467bd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:19.250744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.251691 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.253886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1000/2007] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:19 2022] DELETE /identity/v3/projects/25c1a22fa1af4ccfaa882e9be467bd23 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:19.258476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:19.260204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:19.278837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8023dbba23df4032b62bf950b230ac9d', 'request_id': 'req-66eb49a0-1fc5-4bec-9814-3943c467b60e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.289976 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8023dbba23df4032b62bf950b230ac9d', 'request_id': 'req-66eb49a0-1fc5-4bec-9814-3943c467b60e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.296527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8023dbba23df4032b62bf950b230ac9d', 'request_id': 'req-66eb49a0-1fc5-4bec-9814-3943c467b60e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.308823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:19.324112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] The token cache is being invalidate because project 8023dbba23df4032b62bf950b230ac9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:19.324511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.325519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66eb49a0-1fc5-4bec-9814-3943c467b60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.331198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1008/2008] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:18 2022] DELETE /identity/v3/projects/8023dbba23df4032b62bf950b230ac9d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:19.333872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a08551-bab8-420d-a60b-7fae53bc6a34 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.334215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a08551-bab8-420d-a60b-7fae53bc6a34 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.334518 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a08551-bab8-420d-a60b-7fae53bc6a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.369537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-88a08551-bab8-420d-a60b-7fae53bc6a34 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:19.371578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-88a08551-bab8-420d-a60b-7fae53bc6a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:19.374052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d5344-45ee-4224-ae58-29c1d39b1aee admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:19.387850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:19.461112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:19.462648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.463179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.463513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] PATH_INFO: `/v3/users/6adbf10e70064457881bfa4bbcf93673` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.466025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adbf10e70064457881bfa4bbcf93673)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:19.468880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:19.525757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1009/2009] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:19.539247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547826c-7f1e-49fa-a70e-2ec1ece6365d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.539796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547826c-7f1e-49fa-a70e-2ec1ece6365d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.540278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547826c-7f1e-49fa-a70e-2ec1ece6365d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.547439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adbf10e70064457881bfa4bbcf93673'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.560919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adbf10e70064457881bfa4bbcf93673'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.562419 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adbf10e70064457881bfa4bbcf93673'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.584188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adbf10e70064457881bfa4bbcf93673'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.591314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adbf10e70064457881bfa4bbcf93673'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.596029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1547826c-7f1e-49fa-a70e-2ec1ece6365d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:19.597539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1547826c-7f1e-49fa-a70e-2ec1ece6365d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:19.601327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1001/2010] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:19 2022] DELETE /identity/v3/users/6adbf10e70064457881bfa4bbcf93673 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:19.703722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1010/2011] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:19.708551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:19.720959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46242e57-1583-4231-8ed3-958aa9141b0b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:19.757693 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74a5d-15c3-41db-967b-ff3585a48206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:19.758222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74a5d-15c3-41db-967b-ff3585a48206 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.758575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74a5d-15c3-41db-967b-ff3585a48206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.758947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74a5d-15c3-41db-967b-ff3585a48206 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.759687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af74a5d-15c3-41db-967b-ff3585a48206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:19.761483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af74a5d-15c3-41db-967b-ff3585a48206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:19.773961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af74a5d-15c3-41db-967b-ff3585a48206 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:19.796918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1002/2012] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:19.801943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547826c-7f1e-49fa-a70e-2ec1ece6365d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:19.812798 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547826c-7f1e-49fa-a70e-2ec1ece6365d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:19.819802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7430c7-bca6-4b0d-a714-70af7ec5b010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:19.820517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7430c7-bca6-4b0d-a714-70af7ec5b010 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.820875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7430c7-bca6-4b0d-a714-70af7ec5b010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.821228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7430c7-bca6-4b0d-a714-70af7ec5b010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.822086 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7430c7-bca6-4b0d-a714-70af7ec5b010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:19.824221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7430c7-bca6-4b0d-a714-70af7ec5b010 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:19.858751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1011/2013] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:19 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:19.862412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74a5d-15c3-41db-967b-ff3585a48206 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:19.874988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74a5d-15c3-41db-967b-ff3585a48206 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:19.996468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea227f-a775-4bbf-82dc-fb9b2f9fc7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:19.997114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea227f-a775-4bbf-82dc-fb9b2f9fc7da admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.997399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea227f-a775-4bbf-82dc-fb9b2f9fc7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.997684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea227f-a775-4bbf-82dc-fb9b2f9fc7da admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.998337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea227f-a775-4bbf-82dc-fb9b2f9fc7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.004932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea227f-a775-4bbf-82dc-fb9b2f9fc7da admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.068488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7430c7-bca6-4b0d-a714-70af7ec5b010 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.088978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1003/2014] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:19 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:20.097025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7430c7-bca6-4b0d-a714-70af7ec5b010 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.121948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709daf6-1906-42c6-b7e5-e8b421ce847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.123480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709daf6-1906-42c6-b7e5-e8b421ce847c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.124175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709daf6-1906-42c6-b7e5-e8b421ce847c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.124451 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709daf6-1906-42c6-b7e5-e8b421ce847c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.125122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709daf6-1906-42c6-b7e5-e8b421ce847c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.127415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709daf6-1906-42c6-b7e5-e8b421ce847c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.144363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea227f-a775-4bbf-82dc-fb9b2f9fc7da admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.154136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1012/2015] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:20.161914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea227f-a775-4bbf-82dc-fb9b2f9fc7da admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.178031 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3546c-840e-4f93-8596-d813a56b6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.178722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3546c-840e-4f93-8596-d813a56b6290 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.179015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3546c-840e-4f93-8596-d813a56b6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.179389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3546c-840e-4f93-8596-d813a56b6290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.180031 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3546c-840e-4f93-8596-d813a56b6290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.181707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3546c-840e-4f93-8596-d813a56b6290 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.186109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:20.209202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1004/2016] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:20.214114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709daf6-1906-42c6-b7e5-e8b421ce847c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.228177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709daf6-1906-42c6-b7e5-e8b421ce847c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.239113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24026b51-84e1-4f14-9a5e-eeec8cfdde6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.239972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24026b51-84e1-4f14-9a5e-eeec8cfdde6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.240373 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24026b51-84e1-4f14-9a5e-eeec8cfdde6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.240729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24026b51-84e1-4f14-9a5e-eeec8cfdde6e admin admin] PATH_INFO: `/v3/projects/ed5ce0136bc241f7b2e92bb542bedf44/users/4c8e8ba6496f4d248ad8321420c6888f/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.312032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24026b51-84e1-4f14-9a5e-eeec8cfdde6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5ce0136bc241f7b2e92bb542bedf44, user_id=4c8e8ba6496f4d248ad8321420c6888f, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.312032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24026b51-84e1-4f14-9a5e-eeec8cfdde6e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.336116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1013/2017] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:20 2022] PUT /identity/v3/projects/ed5ce0136bc241f7b2e92bb542bedf44/users/4c8e8ba6496f4d248ad8321420c6888f/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:20.352872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c6b68-58ff-4d5d-ab74-7f9cf5247833 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.353358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c6b68-58ff-4d5d-ab74-7f9cf5247833 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.353807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c6b68-58ff-4d5d-ab74-7f9cf5247833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.416649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ad4c6b68-58ff-4d5d-ab74-7f9cf5247833 None None] MFA Rules not processed for user `4c8e8ba6496f4d248ad8321420c6888f`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:20.417950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ad4c6b68-58ff-4d5d-ab74-7f9cf5247833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:20.526394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1005/2018] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:20.530996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24026b51-84e1-4f14-9a5e-eeec8cfdde6e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.636821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:20.675507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24026b51-84e1-4f14-9a5e-eeec8cfdde6e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.682238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa7aeb-44b9-44d0-95d1-313f0507018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.683994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa7aeb-44b9-44d0-95d1-313f0507018f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.689044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa7aeb-44b9-44d0-95d1-313f0507018f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.689672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa7aeb-44b9-44d0-95d1-313f0507018f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.696384 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa7aeb-44b9-44d0-95d1-313f0507018f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.696384 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa7aeb-44b9-44d0-95d1-313f0507018f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.732936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1014/2019] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:20 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:20.737611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c6b68-58ff-4d5d-ab74-7f9cf5247833 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.760723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c6b68-58ff-4d5d-ab74-7f9cf5247833 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.846707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16748969-aee0-45a1-84db-c3d58e200897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.847656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16748969-aee0-45a1-84db-c3d58e200897 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.848012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16748969-aee0-45a1-84db-c3d58e200897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.848360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16748969-aee0-45a1-84db-c3d58e200897 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.849092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16748969-aee0-45a1-84db-c3d58e200897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.852112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16748969-aee0-45a1-84db-c3d58e200897 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.886362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1006/2020] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:20 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:20.887730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa7aeb-44b9-44d0-95d1-313f0507018f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.900508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa7aeb-44b9-44d0-95d1-313f0507018f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.909233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007b69-4697-4aff-a5cb-c7da9dc1b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.909874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007b69-4697-4aff-a5cb-c7da9dc1b149 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.910157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007b69-4697-4aff-a5cb-c7da9dc1b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.910439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007b69-4697-4aff-a5cb-c7da9dc1b149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.911133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8007b69-4697-4aff-a5cb-c7da9dc1b149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.913669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8007b69-4697-4aff-a5cb-c7da9dc1b149 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.928440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1015/2021] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:20.929718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16748969-aee0-45a1-84db-c3d58e200897 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.940855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16748969-aee0-45a1-84db-c3d58e200897 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.949141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0f8e2-6104-4705-8baf-08907cad2dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.949589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0f8e2-6104-4705-8baf-08907cad2dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.949873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0f8e2-6104-4705-8baf-08907cad2dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.950516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0f8e2-6104-4705-8baf-08907cad2dc7 admin admin] PATH_INFO: `/v3/projects/0b038964117a45efba35ad5b4b756c4b/users/2dc6d33d4ff847f786c244b09f32e2fd/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.973987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0f8e2-6104-4705-8baf-08907cad2dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b038964117a45efba35ad5b4b756c4b, user_id=2dc6d33d4ff847f786c244b09f32e2fd, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.976855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0f8e2-6104-4705-8baf-08907cad2dc7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.993529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1007/2022] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:20 2022] PUT /identity/v3/projects/0b038964117a45efba35ad5b4b756c4b/users/2dc6d33d4ff847f786c244b09f32e2fd/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:20.997695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007b69-4697-4aff-a5cb-c7da9dc1b149 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.008622 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007b69-4697-4aff-a5cb-c7da9dc1b149 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.025526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0f8e2-6104-4705-8baf-08907cad2dc7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.027295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bfa0f8e2-6104-4705-8baf-08907cad2dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:21.136597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:21.151323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fc5e3-7520-421b-87cd-5e7e59aacd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.152107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc5e3-7520-421b-87cd-5e7e59aacd49 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.152496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc5e3-7520-421b-87cd-5e7e59aacd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.153076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc5e3-7520-421b-87cd-5e7e59aacd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.153963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fc5e3-7520-421b-87cd-5e7e59aacd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.155742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fc5e3-7520-421b-87cd-5e7e59aacd49 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.164551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0f8e2-6104-4705-8baf-08907cad2dc7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.172056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.175200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.175601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.175976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] PATH_INFO: `/v3/projects/89ff726ab6dc4905bbc8348e31d5fd98` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.177345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ff726ab6dc4905bbc8348e31d5fd98)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.179439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.194349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1016/2023] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:21.200201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fc5e3-7520-421b-87cd-5e7e59aacd49 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.236841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fc5e3-7520-421b-87cd-5e7e59aacd49 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.245297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ff726ab6dc4905bbc8348e31d5fd98', 'request_id': 'req-fa31d76c-7e82-454f-bad1-77497d108e94'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.257133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ff726ab6dc4905bbc8348e31d5fd98', 'request_id': 'req-fa31d76c-7e82-454f-bad1-77497d108e94'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.265639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ff726ab6dc4905bbc8348e31d5fd98', 'request_id': 'req-fa31d76c-7e82-454f-bad1-77497d108e94'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.287231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] The token cache is being invalidate because project 89ff726ab6dc4905bbc8348e31d5fd98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:21.287738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.288538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa31d76c-7e82-454f-bad1-77497d108e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.290631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1008/2024] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:21 2022] DELETE /identity/v3/projects/89ff726ab6dc4905bbc8348e31d5fd98 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:21.296880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728039-b8de-43e0-9c3e-684a7ff4a3a6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.297545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728039-b8de-43e0-9c3e-684a7ff4a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.297799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728039-b8de-43e0-9c3e-684a7ff4a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.322852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9e728039-b8de-43e0-9c3e-684a7ff4a3a6 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:21.324475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9e728039-b8de-43e0-9c3e-684a7ff4a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:21.373033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c44380-d2f2-438b-9e16-fc645b088f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.373740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c44380-d2f2-438b-9e16-fc645b088f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.374017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c44380-d2f2-438b-9e16-fc645b088f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.374290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c44380-d2f2-438b-9e16-fc645b088f62 admin admin] PATH_INFO: `/v3/projects/0b038964117a45efba35ad5b4b756c4b/users/2dc6d33d4ff847f786c244b09f32e2fd/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.387609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c44380-d2f2-438b-9e16-fc645b088f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b038964117a45efba35ad5b4b756c4b, user_id=2dc6d33d4ff847f786c244b09f32e2fd, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.390314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c44380-d2f2-438b-9e16-fc645b088f62 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.410764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1009/2025] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:21.413543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1017/2026] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:21 2022] PUT /identity/v3/projects/0b038964117a45efba35ad5b4b756c4b/users/2dc6d33d4ff847f786c244b09f32e2fd/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:21.425282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ec453-3b6c-4773-af51-361fb347e004 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.425582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ec453-3b6c-4773-af51-361fb347e004 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.425843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ec453-3b6c-4773-af51-361fb347e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.429137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce39db-1b39-4eea-b66e-5f63fb391db5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.429558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce39db-1b39-4eea-b66e-5f63fb391db5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.429843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce39db-1b39-4eea-b66e-5f63fb391db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.483062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c9ce39db-1b39-4eea-b66e-5f63fb391db5 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:21.488109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c9ce39db-1b39-4eea-b66e-5f63fb391db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:21.491502 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-372ec453-3b6c-4773-af51-361fb347e004 None None] MFA Rules not processed for user `2dc6d33d4ff847f786c244b09f32e2fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:21.495331 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-372ec453-3b6c-4773-af51-361fb347e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:21.573504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:21.716742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1018/2027] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:21.721500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ec453-3b6c-4773-af51-361fb347e004 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.725079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-372ec453-3b6c-4773-af51-361fb347e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:21.735712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1010/2028] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:21.740474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce39db-1b39-4eea-b66e-5f63fb391db5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.777890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c9ce39db-1b39-4eea-b66e-5f63fb391db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:21.801337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ec453-3b6c-4773-af51-361fb347e004 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.806658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.807383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.807678 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.807995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] PATH_INFO: `/v3/users/93d8e07f563246d7b05cd45e0f6ae0cb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.809204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d8e07f563246d7b05cd45e0f6ae0cb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.811663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.858095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:21.917778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d8e07f563246d7b05cd45e0f6ae0cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.937340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce39db-1b39-4eea-b66e-5f63fb391db5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.943789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d8e07f563246d7b05cd45e0f6ae0cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.947454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189544f5-38b8-4992-ac55-293d4dad8ae0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.948071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189544f5-38b8-4992-ac55-293d4dad8ae0 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.948345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189544f5-38b8-4992-ac55-293d4dad8ae0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.948607 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189544f5-38b8-4992-ac55-293d4dad8ae0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.957178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d8e07f563246d7b05cd45e0f6ae0cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.967512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189544f5-38b8-4992-ac55-293d4dad8ae0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.969210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189544f5-38b8-4992-ac55-293d4dad8ae0 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.975370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d8e07f563246d7b05cd45e0f6ae0cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.976158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d8e07f563246d7b05cd45e0f6ae0cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:21.984699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1019/2029] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:21 2022] DELETE /identity/v3/users/93d8e07f563246d7b05cd45e0f6ae0cb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:21.985663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.989706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:22.001767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1011/2030] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:22.002841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629a7d-e590-4e60-ac80-4f5c46dabeaf None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.003124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629a7d-e590-4e60-ac80-4f5c46dabeaf None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.003395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629a7d-e590-4e60-ac80-4f5c46dabeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.044593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7e629a7d-e590-4e60-ac80-4f5c46dabeaf None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:22.045929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7e629a7d-e590-4e60-ac80-4f5c46dabeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:22.147576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454f634-8d7a-4c10-ace4-cc74f98cef22 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:22.153886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19721923-52bb-4697-91b2-fce1d4a713e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:22.154640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19721923-52bb-4697-91b2-fce1d4a713e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.155598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19721923-52bb-4697-91b2-fce1d4a713e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.155976 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19721923-52bb-4697-91b2-fce1d4a713e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.156766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19721923-52bb-4697-91b2-fce1d4a713e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:22.157167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19721923-52bb-4697-91b2-fce1d4a713e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:22.158939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1012/2031] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:22.160450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19721923-52bb-4697-91b2-fce1d4a713e1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:22.160937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629a7d-e590-4e60-ac80-4f5c46dabeaf None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:22.164058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7e629a7d-e590-4e60-ac80-4f5c46dabeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:22.181157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1020/2032] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:22.186293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19721923-52bb-4697-91b2-fce1d4a713e1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:22.192588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629a7d-e590-4e60-ac80-4f5c46dabeaf None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:22.209958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:22.212662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19721923-52bb-4697-91b2-fce1d4a713e1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:22.213409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.213814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.214183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] PATH_INFO: `/v3/users/4c8e8ba6496f4d248ad8321420c6888f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.215809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8e8ba6496f4d248ad8321420c6888f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:22.223726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:22.257171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620c3bc-4be3-4753-b64e-e10d37b0a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:22.260826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620c3bc-4be3-4753-b64e-e10d37b0a995 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.263351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620c3bc-4be3-4753-b64e-e10d37b0a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.270834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620c3bc-4be3-4753-b64e-e10d37b0a995 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.270834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620c3bc-4be3-4753-b64e-e10d37b0a995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:22.272500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620c3bc-4be3-4753-b64e-e10d37b0a995 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:22.349746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8e8ba6496f4d248ad8321420c6888f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:22.361149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1021/2033] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:22 2022] POST /identity/v3/projects => generated 397 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:22.362737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620c3bc-4be3-4753-b64e-e10d37b0a995 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:22.368844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4620c3bc-4be3-4753-b64e-e10d37b0a995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:22.370545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8e8ba6496f4d248ad8321420c6888f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:22.371370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8e8ba6496f4d248ad8321420c6888f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:22.408506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:22.408930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8e8ba6496f4d248ad8321420c6888f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:22.417644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8e8ba6496f4d248ad8321420c6888f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:22.445963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1013/2034] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:22 2022] DELETE /identity/v3/users/4c8e8ba6496f4d248ad8321420c6888f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:22.452805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:22.454829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:22.518858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620c3bc-4be3-4753-b64e-e10d37b0a995 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:22.563936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:22.606874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e61e11-e2f6-4c8f-ad24-a3019c7fdd0b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:22.613805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf78c-bdcf-4241-983f-8aeaf9803ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:22.614841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf78c-bdcf-4241-983f-8aeaf9803ece admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.615294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf78c-bdcf-4241-983f-8aeaf9803ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.615753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf78c-bdcf-4241-983f-8aeaf9803ece admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.616674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf78c-bdcf-4241-983f-8aeaf9803ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:22.619086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf78c-bdcf-4241-983f-8aeaf9803ece admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:22.627615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d2b38-e2a0-46c1-afb2-558477226c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:22.628293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d2b38-e2a0-46c1-afb2-558477226c98 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.628636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d2b38-e2a0-46c1-afb2-558477226c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.628920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d2b38-e2a0-46c1-afb2-558477226c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.631331 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cb5d2b38-e2a0-46c1-afb2-558477226c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:22.654438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d2b38-e2a0-46c1-afb2-558477226c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:22.655973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d2b38-e2a0-46c1-afb2-558477226c98 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:22.663010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1014/2035] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:22 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:22.663010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fc8d1-3601-469e-bbcc-641a21501d78 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.663010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fc8d1-3601-469e-bbcc-641a21501d78 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.663010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fc8d1-3601-469e-bbcc-641a21501d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.684520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1022/2036] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:22.685611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d2b38-e2a0-46c1-afb2-558477226c98 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:22.700416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d2b38-e2a0-46c1-afb2-558477226c98 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:22.707389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534ed5-05e4-4139-be22-89cfc51544cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:22.708761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534ed5-05e4-4139-be22-89cfc51544cb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.709123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534ed5-05e4-4139-be22-89cfc51544cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.709474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534ed5-05e4-4139-be22-89cfc51544cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.710363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed534ed5-05e4-4139-be22-89cfc51544cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:22.712689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed534ed5-05e4-4139-be22-89cfc51544cb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:22.713875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9a1fc8d1-3601-469e-bbcc-641a21501d78 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:22.716426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9a1fc8d1-3601-469e-bbcc-641a21501d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:22.736945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1023/2037] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:22.738907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534ed5-05e4-4139-be22-89cfc51544cb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:22.750961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1015/2038] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:22.752859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534ed5-05e4-4139-be22-89cfc51544cb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:22.759542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a5e3-57a2-451a-9e6a-1fab34836746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:22.760553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a5e3-57a2-451a-9e6a-1fab34836746 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.760553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a5e3-57a2-451a-9e6a-1fab34836746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.760963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a5e3-57a2-451a-9e6a-1fab34836746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.761628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7a5e3-57a2-451a-9e6a-1fab34836746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:22.763910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7a5e3-57a2-451a-9e6a-1fab34836746 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:22.766924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fc8d1-3601-469e-bbcc-641a21501d78 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:22.769803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9a1fc8d1-3601-469e-bbcc-641a21501d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:22.784271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1024/2039] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:22.785931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a5e3-57a2-451a-9e6a-1fab34836746 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:22.787669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fc8d1-3601-469e-bbcc-641a21501d78 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:22.792527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae0bb2-5cd8-443a-bd5d-690d2c42d14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:22.793304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae0bb2-5cd8-443a-bd5d-690d2c42d14b service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.793973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae0bb2-5cd8-443a-bd5d-690d2c42d14b service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.794091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae0bb2-5cd8-443a-bd5d-690d2c42d14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.799714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a5e3-57a2-451a-9e6a-1fab34836746 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:22.806721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310272-990e-458f-8fec-61bbd2e9ba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:22.807726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310272-990e-458f-8fec-61bbd2e9ba64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.808120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310272-990e-458f-8fec-61bbd2e9ba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.808485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310272-990e-458f-8fec-61bbd2e9ba64 admin admin] PATH_INFO: `/v3/projects/118c3bb4680f41c3ac11dfe720147b93/users/3323e8a38af14b59964c0cc7f41d555b/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.809333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae0bb2-5cd8-443a-bd5d-690d2c42d14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:22.811509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae0bb2-5cd8-443a-bd5d-690d2c42d14b service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:22.828092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1016/2040] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:35:22.829695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4310272-990e-458f-8fec-61bbd2e9ba64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118c3bb4680f41c3ac11dfe720147b93, user_id=3323e8a38af14b59964c0cc7f41d555b, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:22.833233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4310272-990e-458f-8fec-61bbd2e9ba64 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:22.866004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1025/2041] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:22 2022] PUT /identity/v3/projects/118c3bb4680f41c3ac11dfe720147b93/users/3323e8a38af14b59964c0cc7f41d555b/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:22.876993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c4f5a-d370-451f-b030-bc41075b32a9 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:22.877444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c4f5a-d370-451f-b030-bc41075b32a9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:22.877723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c4f5a-d370-451f-b030-bc41075b32a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:22.946449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cf2c4f5a-d370-451f-b030-bc41075b32a9 None None] MFA Rules not processed for user `3323e8a38af14b59964c0cc7f41d555b`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:22.949017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cf2c4f5a-d370-451f-b030-bc41075b32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:23.121346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1017/2042] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:23.145006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310272-990e-458f-8fec-61bbd2e9ba64 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:23.147452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f4310272-990e-458f-8fec-61bbd2e9ba64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:23.229593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310272-990e-458f-8fec-61bbd2e9ba64 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:23.234208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca2f60-9799-4fc9-b60b-b60535cf54cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:23.234890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca2f60-9799-4fc9-b60b-b60535cf54cc service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:23.235340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca2f60-9799-4fc9-b60b-b60535cf54cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:23.236814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca2f60-9799-4fc9-b60b-b60535cf54cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:23.247149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca2f60-9799-4fc9-b60b-b60535cf54cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:23.261691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca2f60-9799-4fc9-b60b-b60535cf54cc service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:23.276618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1026/2043] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:23 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:23.369738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c4f5a-d370-451f-b030-bc41075b32a9 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:23.371213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cf2c4f5a-d370-451f-b030-bc41075b32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:23.521655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c4f5a-d370-451f-b030-bc41075b32a9 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:23.529042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:23.529965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:23.530722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:23.531229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] PATH_INFO: `/v3/projects/e58c9d87a1f248ed854bce556959d23e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:23.532631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58c9d87a1f248ed854bce556959d23e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:23.535833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:23.618006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:23.633630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58c9d87a1f248ed854bce556959d23e', 'request_id': 'req-7ea84377-39ab-4562-9842-2dbb69866c53'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.657035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca2f60-9799-4fc9-b60b-b60535cf54cc service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:23.664938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58c9d87a1f248ed854bce556959d23e', 'request_id': 'req-7ea84377-39ab-4562-9842-2dbb69866c53'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.665652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d4ca2f60-9799-4fc9-b60b-b60535cf54cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:23.671703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58c9d87a1f248ed854bce556959d23e', 'request_id': 'req-7ea84377-39ab-4562-9842-2dbb69866c53'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.691855 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca2f60-9799-4fc9-b60b-b60535cf54cc service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:23.704522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] The token cache is being invalidate because project e58c9d87a1f248ed854bce556959d23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:23.704887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.714829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7ea84377-39ab-4562-9842-2dbb69866c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.720812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1018/2044] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:23 2022] DELETE /identity/v3/projects/e58c9d87a1f248ed854bce556959d23e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:23.722241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b7000-eb75-4b6a-9669-7c4d515b728d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:23.722490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b7000-eb75-4b6a-9669-7c4d515b728d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:23.722874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b7000-eb75-4b6a-9669-7c4d515b728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:23.749840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-056b7000-eb75-4b6a-9669-7c4d515b728d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:23.751736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-056b7000-eb75-4b6a-9669-7c4d515b728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:23.788046 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:23.833015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:23.833903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:23.834358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:23.834657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] PATH_INFO: `/v3/projects/ed5ce0136bc241f7b2e92bb542bedf44` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:23.836170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5ce0136bc241f7b2e92bb542bedf44)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:23.838417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:23.886769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1019/2045] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:23.892316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a53af-8afa-4d18-bd53-9e6b60d19ac7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:23.894844 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a53af-8afa-4d18-bd53-9e6b60d19ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:23.896292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a53af-8afa-4d18-bd53-9e6b60d19ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:23.948894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5ce0136bc241f7b2e92bb542bedf44', 'request_id': 'req-ca61ca55-dddf-40e8-8f13-f80be1f97c33'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.949381 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e20a53af-8afa-4d18-bd53-9e6b60d19ac7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:23.952110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e20a53af-8afa-4d18-bd53-9e6b60d19ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:23.961713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5ce0136bc241f7b2e92bb542bedf44', 'request_id': 'req-ca61ca55-dddf-40e8-8f13-f80be1f97c33'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.977812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5ce0136bc241f7b2e92bb542bedf44', 'request_id': 'req-ca61ca55-dddf-40e8-8f13-f80be1f97c33'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.004452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] The token cache is being invalidate because project ed5ce0136bc241f7b2e92bb542bedf44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:24.005196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.006286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.009189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1027/2046] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:23 2022] DELETE /identity/v3/projects/ed5ce0136bc241f7b2e92bb542bedf44 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:24.013464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.016574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.078737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1020/2047] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:24.082564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a53af-8afa-4d18-bd53-9e6b60d19ac7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.096655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a53af-8afa-4d18-bd53-9e6b60d19ac7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.106517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a99fc0-8ea0-4d7c-91b7-f3588516ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.121669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a99fc0-8ea0-4d7c-91b7-f3588516ae10 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.123444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a99fc0-8ea0-4d7c-91b7-f3588516ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.123734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a99fc0-8ea0-4d7c-91b7-f3588516ae10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.126880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a99fc0-8ea0-4d7c-91b7-f3588516ae10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:24.128349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a99fc0-8ea0-4d7c-91b7-f3588516ae10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.139205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a99fc0-8ea0-4d7c-91b7-f3588516ae10 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.152186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1021/2048] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:24.155025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61ca55-dddf-40e8-8f13-f80be1f97c33 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.159036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a99fc0-8ea0-4d7c-91b7-f3588516ae10 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.169158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.170276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.174172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.176763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] PATH_INFO: `/v3/users/2dc6d33d4ff847f786c244b09f32e2fd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.176967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a99fc0-8ea0-4d7c-91b7-f3588516ae10 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.180442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc6d33d4ff847f786c244b09f32e2fd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.185247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.201638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fefacc-873f-4d52-9b4d-dbaddb0f2c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.202267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fefacc-873f-4d52-9b4d-dbaddb0f2c3a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.202654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fefacc-873f-4d52-9b4d-dbaddb0f2c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.203057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fefacc-873f-4d52-9b4d-dbaddb0f2c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.204092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fefacc-873f-4d52-9b4d-dbaddb0f2c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.207483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fefacc-873f-4d52-9b4d-dbaddb0f2c3a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.265621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1022/2049] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:24 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:24.269186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fefacc-873f-4d52-9b4d-dbaddb0f2c3a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.296932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc6d33d4ff847f786c244b09f32e2fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.313133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:24.320131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc6d33d4ff847f786c244b09f32e2fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.328383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:24.331162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc6d33d4ff847f786c244b09f32e2fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.342532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc6d33d4ff847f786c244b09f32e2fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.344104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc6d33d4ff847f786c244b09f32e2fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.353775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1028/2050] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:24 2022] DELETE /identity/v3/users/2dc6d33d4ff847f786c244b09f32e2fd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:24.365394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fefacc-873f-4d52-9b4d-dbaddb0f2c3a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.438070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a4fb9-e6dd-4f9d-9a99-d24b394c148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.438904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a4fb9-e6dd-4f9d-9a99-d24b394c148f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.440118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a4fb9-e6dd-4f9d-9a99-d24b394c148f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.440385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a4fb9-e6dd-4f9d-9a99-d24b394c148f admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.441422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a4fb9-e6dd-4f9d-9a99-d24b394c148f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.443657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a4fb9-e6dd-4f9d-9a99-d24b394c148f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.467775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1023/2051] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:24 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:24.472078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.473467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.491075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7543344-db0e-4f8f-8899-ea3141a7ac85 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.496573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce24b-0303-4ef4-9661-f41935dab8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.497360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce24b-0303-4ef4-9661-f41935dab8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.497922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce24b-0303-4ef4-9661-f41935dab8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.497922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce24b-0303-4ef4-9661-f41935dab8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.498545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ce24b-0303-4ef4-9661-f41935dab8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.500326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ce24b-0303-4ef4-9661-f41935dab8e8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.516487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1029/2052] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:24.517846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a4fb9-e6dd-4f9d-9a99-d24b394c148f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.537535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a4fb9-e6dd-4f9d-9a99-d24b394c148f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.543196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4c548-5da3-4c4a-9a95-6f36cfdd24f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.543898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4c548-5da3-4c4a-9a95-6f36cfdd24f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.544937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4c548-5da3-4c4a-9a95-6f36cfdd24f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.544937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4c548-5da3-4c4a-9a95-6f36cfdd24f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.545186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4c548-5da3-4c4a-9a95-6f36cfdd24f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.547420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4c548-5da3-4c4a-9a95-6f36cfdd24f9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.561944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1024/2053] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:24.563989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce24b-0303-4ef4-9661-f41935dab8e8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.577031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce24b-0303-4ef4-9661-f41935dab8e8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.589081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a07b4-f02c-4480-8e81-cf5de78561d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.590078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a07b4-f02c-4480-8e81-cf5de78561d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.590416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a07b4-f02c-4480-8e81-cf5de78561d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.591524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a07b4-f02c-4480-8e81-cf5de78561d9 admin admin] PATH_INFO: `/v3/projects/7c34e6e9b7344e89b161e05c6b092df7/users/d76690e2eeb34271bf904993430d6b9d/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.611819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a07b4-f02c-4480-8e81-cf5de78561d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c34e6e9b7344e89b161e05c6b092df7, user_id=d76690e2eeb34271bf904993430d6b9d, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.614568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a07b4-f02c-4480-8e81-cf5de78561d9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.639565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1030/2054] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:24 2022] PUT /identity/v3/projects/7c34e6e9b7344e89b161e05c6b092df7/users/d76690e2eeb34271bf904993430d6b9d/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:24.644412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfabf22-506e-4a12-9eb8-3b3ea5ba3dd7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.645480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfabf22-506e-4a12-9eb8-3b3ea5ba3dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.646008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfabf22-506e-4a12-9eb8-3b3ea5ba3dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.684912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7bfabf22-506e-4a12-9eb8-3b3ea5ba3dd7 None None] MFA Rules not processed for user `d76690e2eeb34271bf904993430d6b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:24.686360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7bfabf22-506e-4a12-9eb8-3b3ea5ba3dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.693275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a07b4-f02c-4480-8e81-cf5de78561d9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.695343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0a4a07b4-f02c-4480-8e81-cf5de78561d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.777168 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a07b4-f02c-4480-8e81-cf5de78561d9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.782122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.782848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.783158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.783430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] PATH_INFO: `/v3/projects/0b038964117a45efba35ad5b4b756c4b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.784568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b038964117a45efba35ad5b4b756c4b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.786490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.801701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1025/2055] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:24.813557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfabf22-506e-4a12-9eb8-3b3ea5ba3dd7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.816804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7bfabf22-506e-4a12-9eb8-3b3ea5ba3dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.851517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b038964117a45efba35ad5b4b756c4b', 'request_id': 'req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.860727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b038964117a45efba35ad5b4b756c4b', 'request_id': 'req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.868612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b038964117a45efba35ad5b4b756c4b', 'request_id': 'req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.882355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] The token cache is being invalidate because project 0b038964117a45efba35ad5b4b756c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:24.882814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.883560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e29fd7a5-c74b-4e21-89ed-c4550da3ee6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.885107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1031/2056] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:24 2022] DELETE /identity/v3/projects/0b038964117a45efba35ad5b4b756c4b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:24.889779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2f0a-8ac0-4c76-9713-c13c73c60a52 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.890130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2f0a-8ac0-4c76-9713-c13c73c60a52 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.890477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2f0a-8ac0-4c76-9713-c13c73c60a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.897901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfabf22-506e-4a12-9eb8-3b3ea5ba3dd7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.905423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:24.912532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e55a2f0a-8ac0-4c76-9713-c13c73c60a52 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:24.913854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e55a2f0a-8ac0-4c76-9713-c13c73c60a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.949193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:24.965518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191dfca-9fc7-4923-a0bd-9b9f1319ddb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.966521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191dfca-9fc7-4923-a0bd-9b9f1319ddb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.966847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191dfca-9fc7-4923-a0bd-9b9f1319ddb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.967193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191dfca-9fc7-4923-a0bd-9b9f1319ddb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.969041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f191dfca-9fc7-4923-a0bd-9b9f1319ddb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.984958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1032/2057] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:24.993104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720747d-7db6-42bb-b193-a675d0b1b19f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.993377 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720747d-7db6-42bb-b193-a675d0b1b19f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.993649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720747d-7db6-42bb-b193-a675d0b1b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.015009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d720747d-7db6-42bb-b193-a675d0b1b19f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:25.016224 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d720747d-7db6-42bb-b193-a675d0b1b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:25.031164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1033/2058] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:25.034951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720747d-7db6-42bb-b193-a675d0b1b19f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:25.040623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191dfca-9fc7-4923-a0bd-9b9f1319ddb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.042309 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191dfca-9fc7-4923-a0bd-9b9f1319ddb2 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.049167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720747d-7db6-42bb-b193-a675d0b1b19f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:25.054051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1026/2059] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:25.066120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d140fc6-35ff-442b-947e-9a0b484f932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:25.066778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d140fc6-35ff-442b-947e-9a0b484f932f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.067212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d140fc6-35ff-442b-947e-9a0b484f932f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.067656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d140fc6-35ff-442b-947e-9a0b484f932f admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.068493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d140fc6-35ff-442b-947e-9a0b484f932f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:25.068803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d140fc6-35ff-442b-947e-9a0b484f932f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.070477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d140fc6-35ff-442b-947e-9a0b484f932f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.085189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1034/2060] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:25.089737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191dfca-9fc7-4923-a0bd-9b9f1319ddb2 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:25.102400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191dfca-9fc7-4923-a0bd-9b9f1319ddb2 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:25.107240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25359c-c3de-4ef8-94ee-a70c215bd42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:25.107841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25359c-c3de-4ef8-94ee-a70c215bd42c admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.108121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25359c-c3de-4ef8-94ee-a70c215bd42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.108458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25359c-c3de-4ef8-94ee-a70c215bd42c admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.109362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25359c-c3de-4ef8-94ee-a70c215bd42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.111827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25359c-c3de-4ef8-94ee-a70c215bd42c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.150729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1027/2061] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:25 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:25.153182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d140fc6-35ff-442b-947e-9a0b484f932f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:25.163528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d140fc6-35ff-442b-947e-9a0b484f932f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:25.232461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346f678-ebf3-4166-9644-fe817120734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:25.233080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346f678-ebf3-4166-9644-fe817120734e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.233361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346f678-ebf3-4166-9644-fe817120734e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.233639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346f678-ebf3-4166-9644-fe817120734e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.235184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346f678-ebf3-4166-9644-fe817120734e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.238255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346f678-ebf3-4166-9644-fe817120734e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.268059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1035/2062] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:25 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:25.274737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25359c-c3de-4ef8-94ee-a70c215bd42c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:25.287368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25359c-c3de-4ef8-94ee-a70c215bd42c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:25.293228 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b46f1-9412-4a28-9cb9-50d1819d1340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:25.293500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b46f1-9412-4a28-9cb9-50d1819d1340 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.293783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b46f1-9412-4a28-9cb9-50d1819d1340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.294058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b46f1-9412-4a28-9cb9-50d1819d1340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.294737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b46f1-9412-4a28-9cb9-50d1819d1340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.296457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b46f1-9412-4a28-9cb9-50d1819d1340 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.310023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1028/2063] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:25.315828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346f678-ebf3-4166-9644-fe817120734e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:25.332172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346f678-ebf3-4166-9644-fe817120734e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:25.340316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0be91-bd7f-4faf-b5dd-608e2ebce878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:25.341112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0be91-bd7f-4faf-b5dd-608e2ebce878 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.341494 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0be91-bd7f-4faf-b5dd-608e2ebce878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.341914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0be91-bd7f-4faf-b5dd-608e2ebce878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.343349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0be91-bd7f-4faf-b5dd-608e2ebce878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.345316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0be91-bd7f-4faf-b5dd-608e2ebce878 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.363800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1036/2064] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:25.364530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b46f1-9412-4a28-9cb9-50d1819d1340 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:25.376353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b46f1-9412-4a28-9cb9-50d1819d1340 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:25.382341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456c7fe-d106-49a1-a18a-713a2656d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:25.383039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456c7fe-d106-49a1-a18a-713a2656d072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.383319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456c7fe-d106-49a1-a18a-713a2656d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.383617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456c7fe-d106-49a1-a18a-713a2656d072 admin admin] PATH_INFO: `/v3/projects/d3df74f73d8d4458a6ea02df46a415d9/users/40ca5ae5716a4dae824a35cbdde9edc1/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.401151 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456c7fe-d106-49a1-a18a-713a2656d072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3df74f73d8d4458a6ea02df46a415d9, user_id=40ca5ae5716a4dae824a35cbdde9edc1, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.404420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456c7fe-d106-49a1-a18a-713a2656d072 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.428212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1029/2065] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:25 2022] PUT /identity/v3/projects/d3df74f73d8d4458a6ea02df46a415d9/users/40ca5ae5716a4dae824a35cbdde9edc1/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:25.429603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc553f3-0b39-4110-b417-4873fed66288 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.430112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc553f3-0b39-4110-b417-4873fed66288 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.430464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc553f3-0b39-4110-b417-4873fed66288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.457523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-abc553f3-0b39-4110-b417-4873fed66288 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:25.459043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-abc553f3-0b39-4110-b417-4873fed66288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:25.606672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1037/2066] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:25.618411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456c7fe-d106-49a1-a18a-713a2656d072 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:25.620489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7456c7fe-d106-49a1-a18a-713a2656d072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:25.722862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456c7fe-d106-49a1-a18a-713a2656d072 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:25.727918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c922cbe-0603-49dc-9239-89d74c4b0497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:25.728528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922cbe-0603-49dc-9239-89d74c4b0497 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.728805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922cbe-0603-49dc-9239-89d74c4b0497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.729073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922cbe-0603-49dc-9239-89d74c4b0497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.750012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c922cbe-0603-49dc-9239-89d74c4b0497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.751743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c922cbe-0603-49dc-9239-89d74c4b0497 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.766289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1030/2067] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:26.978085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18e0f1-ea9d-4736-96e9-dfa64c6ceaed None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:26.978717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18e0f1-ea9d-4736-96e9-dfa64c6ceaed None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:26.978717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18e0f1-ea9d-4736-96e9-dfa64c6ceaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.039022 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9c18e0f1-ea9d-4736-96e9-dfa64c6ceaed None None] MFA Rules not processed for user `40ca5ae5716a4dae824a35cbdde9edc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:27.040277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c18e0f1-ea9d-4736-96e9-dfa64c6ceaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:27.078609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:27.209569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1038/2068] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:27.217623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c922cbe-0603-49dc-9239-89d74c4b0497 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:27.222131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7c922cbe-0603-49dc-9239-89d74c4b0497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:27.242872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:27.336527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c922cbe-0603-49dc-9239-89d74c4b0497 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:27.340337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc601b-df2f-4533-9f5b-c453df9a536c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:27.341225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc601b-df2f-4533-9f5b-c453df9a536c service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.341712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc601b-df2f-4533-9f5b-c453df9a536c service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.342214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc601b-df2f-4533-9f5b-c453df9a536c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.352971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc601b-df2f-4533-9f5b-c453df9a536c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:27.354512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc601b-df2f-4533-9f5b-c453df9a536c service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:27.375789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1031/2069] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:28.981367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18e0f1-ea9d-4736-96e9-dfa64c6ceaed None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:28.990013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a96f-f268-4f3c-abfd-b9947518c1c9 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:28.990512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a96f-f268-4f3c-abfd-b9947518c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:28.991389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c18e0f1-ea9d-4736-96e9-dfa64c6ceaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:28.992788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a96f-f268-4f3c-abfd-b9947518c1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:29.032379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18e0f1-ea9d-4736-96e9-dfa64c6ceaed None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:29.034925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4be4a96f-f268-4f3c-abfd-b9947518c1c9 None None] MFA Rules not processed for user `40ca5ae5716a4dae824a35cbdde9edc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:29.036215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4be4a96f-f268-4f3c-abfd-b9947518c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:29.037664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:29.038428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:29.038835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:29.039227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] PATH_INFO: `/v3/users/439521dcf005417cb22a80dc340312ab` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:29.040576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=439521dcf005417cb22a80dc340312ab)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:29.043740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:29.044739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1032/2070] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:29.123311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439521dcf005417cb22a80dc340312ab'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.133285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4a96f-f268-4f3c-abfd-b9947518c1c9 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:29.136359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4be4a96f-f268-4f3c-abfd-b9947518c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:29.145624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439521dcf005417cb22a80dc340312ab'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.156146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4a96f-f268-4f3c-abfd-b9947518c1c9 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:29.157706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439521dcf005417cb22a80dc340312ab'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.162501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:29.163943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:29.164281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:29.164557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] PATH_INFO: `/v3/users/3323e8a38af14b59964c0cc7f41d555b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:29.166387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3323e8a38af14b59964c0cc7f41d555b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:29.168018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439521dcf005417cb22a80dc340312ab'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.168742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:29.170196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7192b56e-65dd-40d7-8b28-9d07e7a441fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439521dcf005417cb22a80dc340312ab'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.185866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1039/2071] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:28 2022] DELETE /identity/v3/users/439521dcf005417cb22a80dc340312ab => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:29.241281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3323e8a38af14b59964c0cc7f41d555b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.252460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3323e8a38af14b59964c0cc7f41d555b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.253632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3323e8a38af14b59964c0cc7f41d555b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.272526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3323e8a38af14b59964c0cc7f41d555b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.288466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3323e8a38af14b59964c0cc7f41d555b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.302343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1033/2072] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:29 2022] DELETE /identity/v3/users/3323e8a38af14b59964c0cc7f41d555b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:29.307549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50d63c-25f1-4727-9795-3a29c5eaab42 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:29.308044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50d63c-25f1-4727-9795-3a29c5eaab42 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:29.308328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50d63c-25f1-4727-9795-3a29c5eaab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:29.332035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6b50d63c-25f1-4727-9795-3a29c5eaab42 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:29.333559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6b50d63c-25f1-4727-9795-3a29c5eaab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:29.404789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1040/2073] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:29.416153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:29.418111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:29.495352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951eb1f-7035-4149-b4b1-f21dac517207 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:29.499011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9ec5-0990-4566-b913-b2c172efdba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:29.499682 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9ec5-0990-4566-b913-b2c172efdba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:29.499968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9ec5-0990-4566-b913-b2c172efdba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:29.500245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9ec5-0990-4566-b913-b2c172efdba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:29.513212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d9ec5-0990-4566-b913-b2c172efdba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:29.514758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d9ec5-0990-4566-b913-b2c172efdba1 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:29.529355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1034/2074] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:29.680497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50d63c-25f1-4727-9795-3a29c5eaab42 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:29.682025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6b50d63c-25f1-4727-9795-3a29c5eaab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:29.695147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50d63c-25f1-4727-9795-3a29c5eaab42 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:29.729648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:29.730312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:29.730586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:29.730877 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] PATH_INFO: `/v3/projects/6eae29572cf24e44b34dbd43e6207a42` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:29.735627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eae29572cf24e44b34dbd43e6207a42)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:29.742452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:29.821377 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:29.837474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eae29572cf24e44b34dbd43e6207a42', 'request_id': 'req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.848062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eae29572cf24e44b34dbd43e6207a42', 'request_id': 'req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.856674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eae29572cf24e44b34dbd43e6207a42', 'request_id': 'req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.871785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] The token cache is being invalidate because project 6eae29572cf24e44b34dbd43e6207a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:29.872203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.873032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:29.875514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1041/2075] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:29 2022] DELETE /identity/v3/projects/6eae29572cf24e44b34dbd43e6207a42 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:29.881789 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63188704-36c7-4a43-945b-01a6222fdf93 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:29.882546 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63188704-36c7-4a43-945b-01a6222fdf93 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:29.883004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63188704-36c7-4a43-945b-01a6222fdf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:29.924307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-63188704-36c7-4a43-945b-01a6222fdf93 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:29.926250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-63188704-36c7-4a43-945b-01a6222fdf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:29.974978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:29.991600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:29.994038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:30.045115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1035/2076] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:30.053820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed4679-37ac-4ba0-9874-752fdad6b5d7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.054104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed4679-37ac-4ba0-9874-752fdad6b5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.054548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed4679-37ac-4ba0-9874-752fdad6b5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.104575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-baed4679-37ac-4ba0-9874-752fdad6b5d7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:30.105950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-baed4679-37ac-4ba0-9874-752fdad6b5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:30.115550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1036/2077] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:30.120018 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed4679-37ac-4ba0-9874-752fdad6b5d7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:30.131074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed4679-37ac-4ba0-9874-752fdad6b5d7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:30.136915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b23d46-25cc-4ef5-a944-3089e60d7f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:30.137872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b23d46-25cc-4ef5-a944-3089e60d7f2d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.138296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b23d46-25cc-4ef5-a944-3089e60d7f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.138570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b23d46-25cc-4ef5-a944-3089e60d7f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.139658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b23d46-25cc-4ef5-a944-3089e60d7f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:30.140247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b23d46-25cc-4ef5-a944-3089e60d7f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:30.143199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b23d46-25cc-4ef5-a944-3089e60d7f2d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:30.143949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968f9c9-924e-4e2b-ad5b-a0f92727dfda admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:30.150325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:30.151281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.151830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.152295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] PATH_INFO: `/v3/projects/118c3bb4680f41c3ac11dfe720147b93` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.155812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] RBAC: Authorizing `identity:delete_project(project_id=118c3bb4680f41c3ac11dfe720147b93)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:30.159260 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:30.161818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1037/2078] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:30.166487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b23d46-25cc-4ef5-a944-3089e60d7f2d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:30.181498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b23d46-25cc-4ef5-a944-3089e60d7f2d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:30.187214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93e903-430b-46e1-bc5b-89a5657123fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:30.188103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e903-430b-46e1-bc5b-89a5657123fd admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.188955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e903-430b-46e1-bc5b-89a5657123fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.190198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e903-430b-46e1-bc5b-89a5657123fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.191943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93e903-430b-46e1-bc5b-89a5657123fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:30.194262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93e903-430b-46e1-bc5b-89a5657123fd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:30.234458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118c3bb4680f41c3ac11dfe720147b93', 'request_id': 'req-f81c7bdf-a418-4740-9f37-4f9f190e895f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:30.234949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1038/2079] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:30 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:30.239787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93e903-430b-46e1-bc5b-89a5657123fd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:30.249123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118c3bb4680f41c3ac11dfe720147b93', 'request_id': 'req-f81c7bdf-a418-4740-9f37-4f9f190e895f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:30.266500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118c3bb4680f41c3ac11dfe720147b93', 'request_id': 'req-f81c7bdf-a418-4740-9f37-4f9f190e895f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:30.281647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] The token cache is being invalidate because project 118c3bb4680f41c3ac11dfe720147b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:30.282180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:30.284615 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:30.287073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1042/2080] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:29 2022] DELETE /identity/v3/projects/118c3bb4680f41c3ac11dfe720147b93 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:30.365846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93e903-430b-46e1-bc5b-89a5657123fd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:30.371760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a911a-6b57-4483-897a-3d9b7085632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:30.373115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a911a-6b57-4483-897a-3d9b7085632a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.373915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a911a-6b57-4483-897a-3d9b7085632a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.374266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a911a-6b57-4483-897a-3d9b7085632a admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.376220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a911a-6b57-4483-897a-3d9b7085632a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:30.379727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a911a-6b57-4483-897a-3d9b7085632a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:30.417199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1039/2081] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:30 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:30.422912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:30.422912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:30.494585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:30.510180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7bdf-a418-4740-9f37-4f9f190e895f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:30.519451 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff56cf-7e79-4b3a-81b2-c178ca7bf362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:30.520600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff56cf-7e79-4b3a-81b2-c178ca7bf362 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.521286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff56cf-7e79-4b3a-81b2-c178ca7bf362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.521659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff56cf-7e79-4b3a-81b2-c178ca7bf362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.522520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff56cf-7e79-4b3a-81b2-c178ca7bf362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:30.524361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff56cf-7e79-4b3a-81b2-c178ca7bf362 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:30.539255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1043/2082] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:30.541110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a911a-6b57-4483-897a-3d9b7085632a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:30.553611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a911a-6b57-4483-897a-3d9b7085632a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:30.560422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ee961-11ae-4538-a724-3acf17771e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:30.560946 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ee961-11ae-4538-a724-3acf17771e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.561228 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ee961-11ae-4538-a724-3acf17771e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.561499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ee961-11ae-4538-a724-3acf17771e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.562155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ee961-11ae-4538-a724-3acf17771e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:30.563939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ee961-11ae-4538-a724-3acf17771e4c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:30.578707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1040/2083] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:30.583478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff56cf-7e79-4b3a-81b2-c178ca7bf362 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:30.595025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff56cf-7e79-4b3a-81b2-c178ca7bf362 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:30.605842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183315e-7894-4058-9d9e-241804fff0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:30.606578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183315e-7894-4058-9d9e-241804fff0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.606886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183315e-7894-4058-9d9e-241804fff0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.607195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183315e-7894-4058-9d9e-241804fff0ff admin admin] PATH_INFO: `/v3/projects/1141e279b1364335af11e078663c470e/users/74b96e81192b4a79b0540923fac91218/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.630651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183315e-7894-4058-9d9e-241804fff0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1141e279b1364335af11e078663c470e, user_id=74b96e81192b4a79b0540923fac91218, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:30.633563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183315e-7894-4058-9d9e-241804fff0ff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:30.648410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1044/2084] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:30 2022] PUT /identity/v3/projects/1141e279b1364335af11e078663c470e/users/74b96e81192b4a79b0540923fac91218/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:30.658923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c26fc-512d-4f51-ae2e-7c8f6b6a7378 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.659211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c26fc-512d-4f51-ae2e-7c8f6b6a7378 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.659486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c26fc-512d-4f51-ae2e-7c8f6b6a7378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.697138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-625c26fc-512d-4f51-ae2e-7c8f6b6a7378 None None] MFA Rules not processed for user `74b96e81192b4a79b0540923fac91218`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:30.699022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-625c26fc-512d-4f51-ae2e-7c8f6b6a7378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:30.751389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:30.774547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1041/2085] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:30.779746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183315e-7894-4058-9d9e-241804fff0ff admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:30.856203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183315e-7894-4058-9d9e-241804fff0ff admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:30.861308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febea071-0eca-4d74-b485-84174c6635c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:30.862371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febea071-0eca-4d74-b485-84174c6635c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.862698 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febea071-0eca-4d74-b485-84174c6635c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.863057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febea071-0eca-4d74-b485-84174c6635c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.863870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febea071-0eca-4d74-b485-84174c6635c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:30.866040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febea071-0eca-4d74-b485-84174c6635c0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:30.903120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1045/2086] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:30 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:30.904292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c26fc-512d-4f51-ae2e-7c8f6b6a7378 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:30.917283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c26fc-512d-4f51-ae2e-7c8f6b6a7378 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:30.990892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6923930-99df-4a59-bfb4-edd4996829c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:30.991492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6923930-99df-4a59-bfb4-edd4996829c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:30.991774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6923930-99df-4a59-bfb4-edd4996829c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:30.992075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6923930-99df-4a59-bfb4-edd4996829c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:30.992672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6923930-99df-4a59-bfb4-edd4996829c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:30.994643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6923930-99df-4a59-bfb4-edd4996829c0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:31.023352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1042/2087] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:30 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:31.027439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febea071-0eca-4d74-b485-84174c6635c0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:31.039725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febea071-0eca-4d74-b485-84174c6635c0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:31.045434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e76f8-6881-4a25-ae92-78cf07727e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:31.046050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e76f8-6881-4a25-ae92-78cf07727e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:31.048183 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e76f8-6881-4a25-ae92-78cf07727e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:31.049112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e76f8-6881-4a25-ae92-78cf07727e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:31.049904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e76f8-6881-4a25-ae92-78cf07727e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:31.052517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e76f8-6881-4a25-ae92-78cf07727e4c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:31.065473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1046/2088] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:31.069586 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6923930-99df-4a59-bfb4-edd4996829c0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:31.081117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6923930-99df-4a59-bfb4-edd4996829c0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:31.090272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf61d-0df0-4725-87b3-81c78f270987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:31.091170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf61d-0df0-4725-87b3-81c78f270987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:31.095184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf61d-0df0-4725-87b3-81c78f270987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:31.096201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf61d-0df0-4725-87b3-81c78f270987 admin admin] PATH_INFO: `/v3/projects/d809f61b77b44aeb8be351fd2b1e30e7/users/4004e96716e6468e8c36af117e20afe4/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:31.121212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daf61d-0df0-4725-87b3-81c78f270987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d809f61b77b44aeb8be351fd2b1e30e7, user_id=4004e96716e6468e8c36af117e20afe4, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:31.124632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daf61d-0df0-4725-87b3-81c78f270987 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:31.140023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1043/2089] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:31 2022] PUT /identity/v3/projects/d809f61b77b44aeb8be351fd2b1e30e7/users/4004e96716e6468e8c36af117e20afe4/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:31.144349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e76f8-6881-4a25-ae92-78cf07727e4c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:31.154199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e76f8-6881-4a25-ae92-78cf07727e4c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:31.211489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64478d3-d9da-44d9-bd44-076660043462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:31.212039 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64478d3-d9da-44d9-bd44-076660043462 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:31.212339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64478d3-d9da-44d9-bd44-076660043462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:31.212616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64478d3-d9da-44d9-bd44-076660043462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:31.213264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64478d3-d9da-44d9-bd44-076660043462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:31.214900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64478d3-d9da-44d9-bd44-076660043462 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:31.225223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1047/2090] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:31.234478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf61d-0df0-4725-87b3-81c78f270987 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:31.244603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf61d-0df0-4725-87b3-81c78f270987 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:31.249428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172fc66-dadf-4ea5-82db-328099a7d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:31.250110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172fc66-dadf-4ea5-82db-328099a7d8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:31.250386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172fc66-dadf-4ea5-82db-328099a7d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:31.250659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172fc66-dadf-4ea5-82db-328099a7d8c1 admin admin] PATH_INFO: `/v3/projects/d809f61b77b44aeb8be351fd2b1e30e7/users/4004e96716e6468e8c36af117e20afe4/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:31.253415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172fc66-dadf-4ea5-82db-328099a7d8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d809f61b77b44aeb8be351fd2b1e30e7, user_id=4004e96716e6468e8c36af117e20afe4, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:31.256094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172fc66-dadf-4ea5-82db-328099a7d8c1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:31.266414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1044/2091] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:31 2022] PUT /identity/v3/projects/d809f61b77b44aeb8be351fd2b1e30e7/users/4004e96716e6468e8c36af117e20afe4/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:31.278140 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42634b80-a25d-4427-9f3b-8543f6533cb3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:31.278427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42634b80-a25d-4427-9f3b-8543f6533cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:31.278743 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42634b80-a25d-4427-9f3b-8543f6533cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:31.318947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-42634b80-a25d-4427-9f3b-8543f6533cb3 None None] MFA Rules not processed for user `4004e96716e6468e8c36af117e20afe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:31.318947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-42634b80-a25d-4427-9f3b-8543f6533cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:31.336885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:31.399278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1048/2092] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:31.411344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172fc66-dadf-4ea5-82db-328099a7d8c1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:31.427627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b172fc66-dadf-4ea5-82db-328099a7d8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:31.491163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172fc66-dadf-4ea5-82db-328099a7d8c1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:31.494875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e64e07-f4d1-48cc-b865-7aa512b94c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:31.495477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e64e07-f4d1-48cc-b865-7aa512b94c8c service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:31.495753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e64e07-f4d1-48cc-b865-7aa512b94c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:31.496066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e64e07-f4d1-48cc-b865-7aa512b94c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:31.506113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e64e07-f4d1-48cc-b865-7aa512b94c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:31.507683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e64e07-f4d1-48cc-b865-7aa512b94c8c service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:31.517275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1045/2093] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:32.271048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42634b80-a25d-4427-9f3b-8543f6533cb3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:32.356131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42634b80-a25d-4427-9f3b-8543f6533cb3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:32.363390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:32.364301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:32.364771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:32.365239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] PATH_INFO: `/v3/users/74b96e81192b4a79b0540923fac91218` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:32.366970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b96e81192b4a79b0540923fac91218)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:32.369403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:32.424343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b96e81192b4a79b0540923fac91218'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:32.437431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b96e81192b4a79b0540923fac91218'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:32.458156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b96e81192b4a79b0540923fac91218'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:32.477915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b96e81192b4a79b0540923fac91218'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:32.478710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b96e81192b4a79b0540923fac91218'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:32.488102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1049/2094] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:32 2022] DELETE /identity/v3/users/74b96e81192b4a79b0540923fac91218 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:32.493124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d14a-0bc5-493a-8ea5-bda6ba9e05dc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:32.493875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d14a-0bc5-493a-8ea5-bda6ba9e05dc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:32.494104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d14a-0bc5-493a-8ea5-bda6ba9e05dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:32.516032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9450d14a-0bc5-493a-8ea5-bda6ba9e05dc None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:32.517395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9450d14a-0bc5-493a-8ea5-bda6ba9e05dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:32.563162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:32.598198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1046/2095] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:32.616494 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:32.617998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:32.684020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:32.708425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd821106-95cd-4392-8ec2-2121d6183bb8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:32.712629 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ad59e-61a9-4def-ab9e-d7cd34992756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:32.713470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad59e-61a9-4def-ab9e-d7cd34992756 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:32.713925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad59e-61a9-4def-ab9e-d7cd34992756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:32.714348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad59e-61a9-4def-ab9e-d7cd34992756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:32.724926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ad59e-61a9-4def-ab9e-d7cd34992756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:32.726387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ad59e-61a9-4def-ab9e-d7cd34992756 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:32.737499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1050/2096] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:33.168176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d14a-0bc5-493a-8ea5-bda6ba9e05dc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:33.169776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9450d14a-0bc5-493a-8ea5-bda6ba9e05dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:33.184276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d14a-0bc5-493a-8ea5-bda6ba9e05dc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:33.192029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:33.192688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:33.192962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:33.193236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] PATH_INFO: `/v3/projects/1141e279b1364335af11e078663c470e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:33.194446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1141e279b1364335af11e078663c470e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:33.199240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:33.268201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1141e279b1364335af11e078663c470e', 'request_id': 'req-fae6bf9e-102e-46e6-bf01-9744cef54d1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.275329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1141e279b1364335af11e078663c470e', 'request_id': 'req-fae6bf9e-102e-46e6-bf01-9744cef54d1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.282464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1141e279b1364335af11e078663c470e', 'request_id': 'req-fae6bf9e-102e-46e6-bf01-9744cef54d1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.301856 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] The token cache is being invalidate because project 1141e279b1364335af11e078663c470e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:33.302401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.303309 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.306389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1047/2097] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:33 2022] DELETE /identity/v3/projects/1141e279b1364335af11e078663c470e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:33.310280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ad59e-61a9-4def-ab9e-d7cd34992756 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:33.328348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ad59e-61a9-4def-ab9e-d7cd34992756 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:33.449996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:33.451002 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:33.451442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:33.451866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] PATH_INFO: `/v3/users/4004e96716e6468e8c36af117e20afe4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:33.453367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4004e96716e6468e8c36af117e20afe4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:33.456621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:33.534231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4004e96716e6468e8c36af117e20afe4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.549741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4004e96716e6468e8c36af117e20afe4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.557740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4004e96716e6468e8c36af117e20afe4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.566605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4004e96716e6468e8c36af117e20afe4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.567580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d160762f-d02a-40a9-812b-3d78e297d4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4004e96716e6468e8c36af117e20afe4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:33.579482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1051/2098] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:33 2022] DELETE /identity/v3/users/4004e96716e6468e8c36af117e20afe4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:34.103441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:34.105628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:34.120992 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6bf9e-102e-46e6-bf01-9744cef54d1a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:34.181192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:34.181818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.182111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.182463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] PATH_INFO: `/v3/projects/d809f61b77b44aeb8be351fd2b1e30e7` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.183765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=d809f61b77b44aeb8be351fd2b1e30e7)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:34.185763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:34.234894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd809f61b77b44aeb8be351fd2b1e30e7', 'request_id': 'req-b88487a1-07ef-49c9-bf95-5ae38577d9be'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:34.241564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd809f61b77b44aeb8be351fd2b1e30e7', 'request_id': 'req-b88487a1-07ef-49c9-bf95-5ae38577d9be'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:34.247742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd809f61b77b44aeb8be351fd2b1e30e7', 'request_id': 'req-b88487a1-07ef-49c9-bf95-5ae38577d9be'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:34.250573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:34.262838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] The token cache is being invalidate because project d809f61b77b44aeb8be351fd2b1e30e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:34.263245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:34.263898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b88487a1-07ef-49c9-bf95-5ae38577d9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:34.265402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1048/2099] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:34 2022] DELETE /identity/v3/projects/d809f61b77b44aeb8be351fd2b1e30e7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:34.272821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2dfcd-fa6a-4737-b12a-b85cf4547535 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.273103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2dfcd-fa6a-4737-b12a-b85cf4547535 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.273443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2dfcd-fa6a-4737-b12a-b85cf4547535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.293900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6ff2dfcd-fa6a-4737-b12a-b85cf4547535 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:34.295115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ff2dfcd-fa6a-4737-b12a-b85cf4547535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:34.347025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:34.357079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1052/2100] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:34.365099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b704-7c10-4b5f-a613-f7dabda8b1a1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.365414 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b704-7c10-4b5f-a613-f7dabda8b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.365688 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b704-7c10-4b5f-a613-f7dabda8b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.385995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7545b704-7c10-4b5f-a613-f7dabda8b1a1 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:34.387263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7545b704-7c10-4b5f-a613-f7dabda8b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:34.395881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1049/2101] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:34.400084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2dfcd-fa6a-4737-b12a-b85cf4547535 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:34.409820 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2dfcd-fa6a-4737-b12a-b85cf4547535 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:34.414674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f47f4-dad0-485a-8b7c-6a77637c8530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:34.415336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f47f4-dad0-485a-8b7c-6a77637c8530 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.415620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f47f4-dad0-485a-8b7c-6a77637c8530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.415896 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f47f4-dad0-485a-8b7c-6a77637c8530 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.416552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f47f4-dad0-485a-8b7c-6a77637c8530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:34.416857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f47f4-dad0-485a-8b7c-6a77637c8530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:34.418476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f47f4-dad0-485a-8b7c-6a77637c8530 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:34.430729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1053/2102] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:34.435182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b704-7c10-4b5f-a613-f7dabda8b1a1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:34.445162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b704-7c10-4b5f-a613-f7dabda8b1a1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:34.449777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e181b22-84b0-42c5-8356-3e9581f6724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:34.450368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e181b22-84b0-42c5-8356-3e9581f6724f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.450658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e181b22-84b0-42c5-8356-3e9581f6724f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.450947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e181b22-84b0-42c5-8356-3e9581f6724f admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.451582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e181b22-84b0-42c5-8356-3e9581f6724f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:34.453522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e181b22-84b0-42c5-8356-3e9581f6724f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:34.480294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1050/2103] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:34 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:34.484993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f47f4-dad0-485a-8b7c-6a77637c8530 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:34.495297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f47f4-dad0-485a-8b7c-6a77637c8530 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:34.551617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dadc28-f84c-42e0-9baa-54a423fef8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:34.552218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dadc28-f84c-42e0-9baa-54a423fef8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.552501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dadc28-f84c-42e0-9baa-54a423fef8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.552779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dadc28-f84c-42e0-9baa-54a423fef8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.553406 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dadc28-f84c-42e0-9baa-54a423fef8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:34.555591 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dadc28-f84c-42e0-9baa-54a423fef8b2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:34.576845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1054/2104] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:34 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:34.581481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e181b22-84b0-42c5-8356-3e9581f6724f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:34.591824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e181b22-84b0-42c5-8356-3e9581f6724f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:34.596546 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34933d56-a887-4374-9c29-74ee6bbd66c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:34.597136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34933d56-a887-4374-9c29-74ee6bbd66c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.597413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34933d56-a887-4374-9c29-74ee6bbd66c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.597681 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34933d56-a887-4374-9c29-74ee6bbd66c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.598315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34933d56-a887-4374-9c29-74ee6bbd66c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:34.599939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34933d56-a887-4374-9c29-74ee6bbd66c0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:34.609858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1051/2105] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:34.613930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dadc28-f84c-42e0-9baa-54a423fef8b2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:34.624201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dadc28-f84c-42e0-9baa-54a423fef8b2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:34.629445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39b2e-1f85-40b6-9e7d-c403a6d9ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:34.630040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39b2e-1f85-40b6-9e7d-c403a6d9ff3a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.630323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39b2e-1f85-40b6-9e7d-c403a6d9ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.630597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39b2e-1f85-40b6-9e7d-c403a6d9ff3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.631280 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39b2e-1f85-40b6-9e7d-c403a6d9ff3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:34.632883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39b2e-1f85-40b6-9e7d-c403a6d9ff3a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:34.644128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1055/2106] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:34.648248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34933d56-a887-4374-9c29-74ee6bbd66c0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:34.658234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34933d56-a887-4374-9c29-74ee6bbd66c0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:34.662941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e011a-e6c7-45e3-8bca-4727b699c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:34.663580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e011a-e6c7-45e3-8bca-4727b699c57f admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.663859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e011a-e6c7-45e3-8bca-4727b699c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.664131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e011a-e6c7-45e3-8bca-4727b699c57f admin admin] PATH_INFO: `/v3/projects/0ee6202daeda471c97eb2b367bc82e9d/users/bc5f2736ff0546a387f4fff3e89622ec/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.678820 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e011a-e6c7-45e3-8bca-4727b699c57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee6202daeda471c97eb2b367bc82e9d, user_id=bc5f2736ff0546a387f4fff3e89622ec, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:34.681470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e011a-e6c7-45e3-8bca-4727b699c57f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:34.696778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1052/2107] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:34 2022] PUT /identity/v3/projects/0ee6202daeda471c97eb2b367bc82e9d/users/bc5f2736ff0546a387f4fff3e89622ec/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:34.707030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15ead-a6ab-41da-a885-05902e5b484d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.707314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15ead-a6ab-41da-a885-05902e5b484d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.708134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15ead-a6ab-41da-a885-05902e5b484d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.738184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eeb15ead-a6ab-41da-a885-05902e5b484d None None] MFA Rules not processed for user `bc5f2736ff0546a387f4fff3e89622ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:34.739469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eeb15ead-a6ab-41da-a885-05902e5b484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:34.808229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1056/2108] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:34.812541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e011a-e6c7-45e3-8bca-4727b699c57f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:34.875786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e011a-e6c7-45e3-8bca-4727b699c57f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:34.882267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c557d9a-70af-42d1-9186-df74be906c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:34.882902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557d9a-70af-42d1-9186-df74be906c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:34.883185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557d9a-70af-42d1-9186-df74be906c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:34.883459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557d9a-70af-42d1-9186-df74be906c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:34.884106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c557d9a-70af-42d1-9186-df74be906c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:34.886060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c557d9a-70af-42d1-9186-df74be906c6a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:34.913616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1053/2109] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:34 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:34.917701 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb15ead-a6ab-41da-a885-05902e5b484d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:34.929212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb15ead-a6ab-41da-a885-05902e5b484d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:34.988395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:34.999198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbbc0e-99d9-48ce-a49f-2d9d6430080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:34.999726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbbc0e-99d9-48ce-a49f-2d9d6430080b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.000143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbbc0e-99d9-48ce-a49f-2d9d6430080b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.000356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbbc0e-99d9-48ce-a49f-2d9d6430080b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.001000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbbc0e-99d9-48ce-a49f-2d9d6430080b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:35.003560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbbc0e-99d9-48ce-a49f-2d9d6430080b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:35.030159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1057/2110] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:34 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:35.034975 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c557d9a-70af-42d1-9186-df74be906c6a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:35.056241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c557d9a-70af-42d1-9186-df74be906c6a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:35.061122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da23a0-4149-49c4-9f28-e2de49f61199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:35.061694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da23a0-4149-49c4-9f28-e2de49f61199 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.061988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da23a0-4149-49c4-9f28-e2de49f61199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.062225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da23a0-4149-49c4-9f28-e2de49f61199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.063560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da23a0-4149-49c4-9f28-e2de49f61199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:35.066551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da23a0-4149-49c4-9f28-e2de49f61199 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:35.080515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1054/2111] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:35.084896 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbbc0e-99d9-48ce-a49f-2d9d6430080b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:35.099613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbbc0e-99d9-48ce-a49f-2d9d6430080b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:35.105166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50445e4a-6ed7-4bca-b55b-67c69e022361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:35.105835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50445e4a-6ed7-4bca-b55b-67c69e022361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.106118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50445e4a-6ed7-4bca-b55b-67c69e022361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.106397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50445e4a-6ed7-4bca-b55b-67c69e022361 admin admin] PATH_INFO: `/v3/projects/7feb65b27620424fb442eda5ed92bbd5/users/2e2f91aa00ed4270a2394748a8e6e081/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.130106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50445e4a-6ed7-4bca-b55b-67c69e022361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7feb65b27620424fb442eda5ed92bbd5, user_id=2e2f91aa00ed4270a2394748a8e6e081, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:35.133076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50445e4a-6ed7-4bca-b55b-67c69e022361 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:35.161765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1058/2112] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:35 2022] PUT /identity/v3/projects/7feb65b27620424fb442eda5ed92bbd5/users/2e2f91aa00ed4270a2394748a8e6e081/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:35.163910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da23a0-4149-49c4-9f28-e2de49f61199 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:35.176339 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da23a0-4149-49c4-9f28-e2de49f61199 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:35.187822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50445e4a-6ed7-4bca-b55b-67c69e022361 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:35.190018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-50445e4a-6ed7-4bca-b55b-67c69e022361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:35.271423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee78d-2e98-4309-8555-a027775911e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:35.272320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee78d-2e98-4309-8555-a027775911e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.272665 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee78d-2e98-4309-8555-a027775911e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.273011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee78d-2e98-4309-8555-a027775911e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.274009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ee78d-2e98-4309-8555-a027775911e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:35.275842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ee78d-2e98-4309-8555-a027775911e5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:35.285324 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:35.285569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50445e4a-6ed7-4bca-b55b-67c69e022361 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:35.292446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:35.293323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.293657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.293936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] PATH_INFO: `/v3/users/5e934b39bac1433d9e687feb387c8583` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.295197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e934b39bac1433d9e687feb387c8583)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:35.295623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1055/2113] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:35.297140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee78d-2e98-4309-8555-a027775911e5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:35.297573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:35.310275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee78d-2e98-4309-8555-a027775911e5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:35.316704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ec3e-f63d-473d-b26b-ef5f91039064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:35.317410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ec3e-f63d-473d-b26b-ef5f91039064 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.317692 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ec3e-f63d-473d-b26b-ef5f91039064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.317969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ec3e-f63d-473d-b26b-ef5f91039064 admin admin] PATH_INFO: `/v3/projects/7feb65b27620424fb442eda5ed92bbd5/users/2e2f91aa00ed4270a2394748a8e6e081/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.320420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1ec3e-f63d-473d-b26b-ef5f91039064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7feb65b27620424fb442eda5ed92bbd5, user_id=2e2f91aa00ed4270a2394748a8e6e081, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:35.323314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1ec3e-f63d-473d-b26b-ef5f91039064 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:35.337512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1056/2114] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:35 2022] PUT /identity/v3/projects/7feb65b27620424fb442eda5ed92bbd5/users/2e2f91aa00ed4270a2394748a8e6e081/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:35.351289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2928f24-fec8-494e-a563-a9abb2a97579 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.351571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2928f24-fec8-494e-a563-a9abb2a97579 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.351839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2928f24-fec8-494e-a563-a9abb2a97579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.355665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e934b39bac1433d9e687feb387c8583'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:35.376044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e934b39bac1433d9e687feb387c8583'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:35.386595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e934b39bac1433d9e687feb387c8583'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:35.387038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d2928f24-fec8-494e-a563-a9abb2a97579 None None] MFA Rules not processed for user `2e2f91aa00ed4270a2394748a8e6e081`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:35.388478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d2928f24-fec8-494e-a563-a9abb2a97579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:35.396543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e934b39bac1433d9e687feb387c8583'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:35.397348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02545922-2a55-4fd4-a256-cf453b299185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e934b39bac1433d9e687feb387c8583'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:35.403607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1059/2115] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:35 2022] DELETE /identity/v3/users/5e934b39bac1433d9e687feb387c8583 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:35.408067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902a7a-2dd2-4fd8-92bd-4f4454f02ea1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.409013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902a7a-2dd2-4fd8-92bd-4f4454f02ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.409541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902a7a-2dd2-4fd8-92bd-4f4454f02ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.431514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9e902a7a-2dd2-4fd8-92bd-4f4454f02ea1 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:35.432733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e902a7a-2dd2-4fd8-92bd-4f4454f02ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:35.473953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:35.476244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1057/2116] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:35.490650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2928f24-fec8-494e-a563-a9abb2a97579 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:35.492190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d2928f24-fec8-494e-a563-a9abb2a97579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:35.506556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1060/2117] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:35.516226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902a7a-2dd2-4fd8-92bd-4f4454f02ea1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:35.518231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e902a7a-2dd2-4fd8-92bd-4f4454f02ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:35.555596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2928f24-fec8-494e-a563-a9abb2a97579 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:35.583548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902a7a-2dd2-4fd8-92bd-4f4454f02ea1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:35.587786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71aaf4f-0069-473b-9e4c-7da98608d5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:35.589052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aaf4f-0069-473b-9e4c-7da98608d5fb service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.589463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aaf4f-0069-473b-9e4c-7da98608d5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.589749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aaf4f-0069-473b-9e4c-7da98608d5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.599747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71aaf4f-0069-473b-9e4c-7da98608d5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:35.601236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71aaf4f-0069-473b-9e4c-7da98608d5fb service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:35.610299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547321-5a28-49c2-b91c-eac9f2c3aafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:35.611058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547321-5a28-49c2-b91c-eac9f2c3aafb service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.611333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547321-5a28-49c2-b91c-eac9f2c3aafb service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.612276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547321-5a28-49c2-b91c-eac9f2c3aafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.612900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1061/2118] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:35:35.657292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:35.688640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd547321-5a28-49c2-b91c-eac9f2c3aafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:35.694773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd547321-5a28-49c2-b91c-eac9f2c3aafb service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:35.701216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1058/2119] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:35:35.926317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71aaf4f-0069-473b-9e4c-7da98608d5fb service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:35.927880 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c71aaf4f-0069-473b-9e4c-7da98608d5fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:35.942159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71aaf4f-0069-473b-9e4c-7da98608d5fb service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:35.948262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:35.949949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.950241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.950912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] PATH_INFO: `/v3/projects/80ec3d7c3a54447d9202da589b6e8b10` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.952360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ec3d7c3a54447d9202da589b6e8b10)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:35.954900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.028270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ec3d7c3a54447d9202da589b6e8b10', 'request_id': 'req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.036901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ec3d7c3a54447d9202da589b6e8b10', 'request_id': 'req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.044073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ec3d7c3a54447d9202da589b6e8b10', 'request_id': 'req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.064148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] The token cache is being invalidate because project 80ec3d7c3a54447d9202da589b6e8b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:36.064443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.064554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547321-5a28-49c2-b91c-eac9f2c3aafb service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.065974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.067503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1062/2120] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:35 2022] DELETE /identity/v3/projects/80ec3d7c3a54447d9202da589b6e8b10 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:36.071051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.072345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.076951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547321-5a28-49c2-b91c-eac9f2c3aafb service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.141306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f91aa00ed4270a2394748a8e6e081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7feb65b27620424fb442eda5ed92bbd5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.141918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.142201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.142475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.144011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:36.144499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.146130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.148489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7e5c2-d5a2-41e9-a326-680a2f86afa1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.153166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.153794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.154070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.154340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] PATH_INFO: `/v3/users/d381c7272ba848b49e7eddbb97435181` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.155506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d381c7272ba848b49e7eddbb97435181)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.157453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.157945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1059/2121] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:35:36.159630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.161726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.164490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:36.176459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a56c5-7b45-480c-b118-9cc25021e902 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.181029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.181643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.181919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.182188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] PATH_INFO: `/v3/users/d76690e2eeb34271bf904993430d6b9d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.183368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76690e2eeb34271bf904993430d6b9d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.185315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.211183 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd381c7272ba848b49e7eddbb97435181'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.225336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd381c7272ba848b49e7eddbb97435181'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.232826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd381c7272ba848b49e7eddbb97435181'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.235662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76690e2eeb34271bf904993430d6b9d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.241942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd381c7272ba848b49e7eddbb97435181'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.242589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd381c7272ba848b49e7eddbb97435181'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.243875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76690e2eeb34271bf904993430d6b9d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.244538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76690e2eeb34271bf904993430d6b9d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.249217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1063/2122] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:36 2022] DELETE /identity/v3/users/d381c7272ba848b49e7eddbb97435181 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:36.250171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.251505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.260315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76690e2eeb34271bf904993430d6b9d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.269048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-575345c5-f388-493d-a14d-ce1d79010b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76690e2eeb34271bf904993430d6b9d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.275505 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1060/2123] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:36 2022] DELETE /identity/v3/users/d76690e2eeb34271bf904993430d6b9d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:36.279788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132f9ff-c062-4df4-8eb1-9398c7357931 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.280235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132f9ff-c062-4df4-8eb1-9398c7357931 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.280503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132f9ff-c062-4df4-8eb1-9398c7357931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.306043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7132f9ff-c062-4df4-8eb1-9398c7357931 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:36.308224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7132f9ff-c062-4df4-8eb1-9398c7357931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.332851 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602cb2a-809d-4166-8313-4da31b87018f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.354861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:36.376449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1061/2124] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:36.388009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132f9ff-c062-4df4-8eb1-9398c7357931 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.389490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7132f9ff-c062-4df4-8eb1-9398c7357931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.430736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf7e9-da59-4ebe-9889-239ba78e348f tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f91aa00ed4270a2394748a8e6e081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7feb65b27620424fb442eda5ed92bbd5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.431552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf7e9-da59-4ebe-9889-239ba78e348f tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.431844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf7e9-da59-4ebe-9889-239ba78e348f tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.432170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf7e9-da59-4ebe-9889-239ba78e348f tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.433758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bf7e9-da59-4ebe-9889-239ba78e348f tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.436131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bf7e9-da59-4ebe-9889-239ba78e348f tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.467609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132f9ff-c062-4df4-8eb1-9398c7357931 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.472854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcb1c3-853c-4db9-b373-ea4ca065d7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.473683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcb1c3-853c-4db9-b373-ea4ca065d7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.473945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcb1c3-853c-4db9-b373-ea4ca065d7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.474316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcb1c3-853c-4db9-b373-ea4ca065d7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.476631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1064/2125] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:36 2022] POST /identity/v3/projects => generated 354 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:36.481718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf7e9-da59-4ebe-9889-239ba78e348f tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.485635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-526bf7e9-da59-4ebe-9889-239ba78e348f tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.492062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcb1c3-853c-4db9-b373-ea4ca065d7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.495171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcb1c3-853c-4db9-b373-ea4ca065d7a3 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.509739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1062/2126] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:36.521221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:36.588358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf7e9-da59-4ebe-9889-239ba78e348f tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.591730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcb1c3-853c-4db9-b373-ea4ca065d7a3 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.593348 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fffcb1c3-853c-4db9-b373-ea4ca065d7a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.593678 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171765-a2c9-4e43-94d8-bd06e123cf3d tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f91aa00ed4270a2394748a8e6e081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7feb65b27620424fb442eda5ed92bbd5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.594300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171765-a2c9-4e43-94d8-bd06e123cf3d tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.594593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171765-a2c9-4e43-94d8-bd06e123cf3d tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.594907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171765-a2c9-4e43-94d8-bd06e123cf3d tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.595577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af171765-a2c9-4e43-94d8-bd06e123cf3d tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:36.595922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af171765-a2c9-4e43-94d8-bd06e123cf3d tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.597565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af171765-a2c9-4e43-94d8-bd06e123cf3d tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.610878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1065/2127] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:36.613111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcb1c3-853c-4db9-b373-ea4ca065d7a3 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.664237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171765-a2c9-4e43-94d8-bd06e123cf3d tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.675302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171765-a2c9-4e43-94d8-bd06e123cf3d tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.680876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f91aa00ed4270a2394748a8e6e081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7feb65b27620424fb442eda5ed92bbd5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.681641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.681913 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.682195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] PATH_INFO: `/v3/projects/4dc8f03c4b1044eb85702611abb32040` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.683526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4dc8f03c4b1044eb85702611abb32040)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.685523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.701945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.702582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.702949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.703319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] PATH_INFO: `/v3/projects/1eaaa076244249399fd8c3c8f1964de5` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.705143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eaaa076244249399fd8c3c8f1964de5)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.708651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.755321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc8f03c4b1044eb85702611abb32040', 'request_id': 'req-aeb6d603-86f3-481f-9f08-aca4e84bd942'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.764482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc8f03c4b1044eb85702611abb32040', 'request_id': 'req-aeb6d603-86f3-481f-9f08-aca4e84bd942'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.766370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eaaa076244249399fd8c3c8f1964de5', 'request_id': 'req-03282613-8490-4788-a25e-af27d67fbecf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.771302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc8f03c4b1044eb85702611abb32040', 'request_id': 'req-aeb6d603-86f3-481f-9f08-aca4e84bd942'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.774190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eaaa076244249399fd8c3c8f1964de5', 'request_id': 'req-03282613-8490-4788-a25e-af27d67fbecf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.780332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eaaa076244249399fd8c3c8f1964de5', 'request_id': 'req-03282613-8490-4788-a25e-af27d67fbecf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.786102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] The token cache is being invalidate because project 4dc8f03c4b1044eb85702611abb32040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:36.786398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.787288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aeb6d603-86f3-481f-9f08-aca4e84bd942 tempest-VolumeQuotaClassesTest-886232557 tempest-VolumeQuotaClassesTest-886232557-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.788965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1066/2128] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:36 2022] DELETE /identity/v3/projects/4dc8f03c4b1044eb85702611abb32040 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:36.801598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] The token cache is being invalidate because project 1eaaa076244249399fd8c3c8f1964de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:36.801899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.802565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.804328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1063/2129] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:36 2022] DELETE /identity/v3/projects/1eaaa076244249399fd8c3c8f1964de5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:36.809768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ae76-9e29-4e61-8910-52b04175b644 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.810282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ae76-9e29-4e61-8910-52b04175b644 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.810552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ae76-9e29-4e61-8910-52b04175b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.831163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8502ae76-9e29-4e61-8910-52b04175b644 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:36.832376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8502ae76-9e29-4e61-8910-52b04175b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.873511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.876148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.914744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1067/2130] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:36.915836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:36.922147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf0877-1def-4347-9c81-04e9d618d847 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.923349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf0877-1def-4347-9c81-04e9d618d847 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.923993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf0877-1def-4347-9c81-04e9d618d847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.953592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eadf0877-1def-4347-9c81-04e9d618d847 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:36.959217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eadf0877-1def-4347-9c81-04e9d618d847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.973180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1068/2131] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:36.977316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf0877-1def-4347-9c81-04e9d618d847 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.988703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf0877-1def-4347-9c81-04e9d618d847 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.994358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03282613-8490-4788-a25e-af27d67fbecf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.999910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fb42f-baf8-46d1-ab2d-1b009b8e6bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.000880 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fb42f-baf8-46d1-ab2d-1b009b8e6bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.001227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fb42f-baf8-46d1-ab2d-1b009b8e6bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.001570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fb42f-baf8-46d1-ab2d-1b009b8e6bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.002902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fb42f-baf8-46d1-ab2d-1b009b8e6bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:37.003950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fb42f-baf8-46d1-ab2d-1b009b8e6bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.006266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fb42f-baf8-46d1-ab2d-1b009b8e6bf4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.007168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.007904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.008256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.008643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] PATH_INFO: `/v3/projects/7c34e6e9b7344e89b161e05c6b092df7` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.010611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c34e6e9b7344e89b161e05c6b092df7)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.013182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.026238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1069/2132] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:35:37.031099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fb42f-baf8-46d1-ab2d-1b009b8e6bf4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.047778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fb42f-baf8-46d1-ab2d-1b009b8e6bf4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.055027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729673d-bc8c-4cd9-abdb-54603fd35d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.055677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729673d-bc8c-4cd9-abdb-54603fd35d77 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.056019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729673d-bc8c-4cd9-abdb-54603fd35d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.056315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729673d-bc8c-4cd9-abdb-54603fd35d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.056972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729673d-bc8c-4cd9-abdb-54603fd35d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.059124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729673d-bc8c-4cd9-abdb-54603fd35d77 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.087119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c34e6e9b7344e89b161e05c6b092df7', 'request_id': 'req-46704191-a8f3-4b0e-9563-c1eae657c360'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.095702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:37.098698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c34e6e9b7344e89b161e05c6b092df7', 'request_id': 'req-46704191-a8f3-4b0e-9563-c1eae657c360'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.112467 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c34e6e9b7344e89b161e05c6b092df7', 'request_id': 'req-46704191-a8f3-4b0e-9563-c1eae657c360'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.114726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1070/2133] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:37.115419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729673d-bc8c-4cd9-abdb-54603fd35d77 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.118292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b729673d-bc8c-4cd9-abdb-54603fd35d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:37.135955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] The token cache is being invalidate because project 7c34e6e9b7344e89b161e05c6b092df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:37.136474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.137323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.139549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1064/2134] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:36 2022] DELETE /identity/v3/projects/7c34e6e9b7344e89b161e05c6b092df7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:37.140663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.144735 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:37.193039 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729673d-bc8c-4cd9-abdb-54603fd35d77 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.198209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.199013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.199434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.199715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] PATH_INFO: `/v3/users/bc5f2736ff0546a387f4fff3e89622ec` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.201291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5f2736ff0546a387f4fff3e89622ec)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.202882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.226440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46704191-a8f3-4b0e-9563-c1eae657c360 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.232663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405871f0-5cb1-4a4d-b4ca-553d0cc084b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.233279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405871f0-5cb1-4a4d-b4ca-553d0cc084b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.233612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405871f0-5cb1-4a4d-b4ca-553d0cc084b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.233897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405871f0-5cb1-4a4d-b4ca-553d0cc084b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.234849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405871f0-5cb1-4a4d-b4ca-553d0cc084b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.237523 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405871f0-5cb1-4a4d-b4ca-553d0cc084b0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.266077 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1065/2135] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:37.271376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68559e9d-8da2-4002-8e51-97e6e84a5a2d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.271662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68559e9d-8da2-4002-8e51-97e6e84a5a2d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.271948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68559e9d-8da2-4002-8e51-97e6e84a5a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.283263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5f2736ff0546a387f4fff3e89622ec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.296685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-68559e9d-8da2-4002-8e51-97e6e84a5a2d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:37.298085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-68559e9d-8da2-4002-8e51-97e6e84a5a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:37.298864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5f2736ff0546a387f4fff3e89622ec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.306978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5f2736ff0546a387f4fff3e89622ec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.316705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1066/2136] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:37.317109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5f2736ff0546a387f4fff3e89622ec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.317862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-583c030d-2341-4824-ab9a-b291b57d8d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5f2736ff0546a387f4fff3e89622ec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.323589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68559e9d-8da2-4002-8e51-97e6e84a5a2d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.328014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1071/2137] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:37 2022] DELETE /identity/v3/users/bc5f2736ff0546a387f4fff3e89622ec => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:37.328014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45424338-13b1-491e-ad3b-1f8c7259b2c2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.328014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45424338-13b1-491e-ad3b-1f8c7259b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.328014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45424338-13b1-491e-ad3b-1f8c7259b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.333445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68559e9d-8da2-4002-8e51-97e6e84a5a2d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.348404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-45424338-13b1-491e-ad3b-1f8c7259b2c2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:37.349631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-45424338-13b1-491e-ad3b-1f8c7259b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:37.366351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:37.400603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64851d18-e374-4819-9960-21c30cf57175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.401146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64851d18-e374-4819-9960-21c30cf57175 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.401428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64851d18-e374-4819-9960-21c30cf57175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.401702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64851d18-e374-4819-9960-21c30cf57175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.402347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64851d18-e374-4819-9960-21c30cf57175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.403997 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64851d18-e374-4819-9960-21c30cf57175 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.414894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1072/2138] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:37.417909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1067/2139] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:37.418058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d302c5-73c1-4407-ba7a-ef4f150d82a7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.418058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d302c5-73c1-4407-ba7a-ef4f150d82a7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.418058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d302c5-73c1-4407-ba7a-ef4f150d82a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.419239 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64851d18-e374-4819-9960-21c30cf57175 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.421039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-64851d18-e374-4819-9960-21c30cf57175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:37.434006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64851d18-e374-4819-9960-21c30cf57175 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.436872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c7d302c5-73c1-4407-ba7a-ef4f150d82a7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:37.438042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c7d302c5-73c1-4407-ba7a-ef4f150d82a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:37.438945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab32977-826e-45fa-8904-54dd32ee0544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.439542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab32977-826e-45fa-8904-54dd32ee0544 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.439845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab32977-826e-45fa-8904-54dd32ee0544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.440118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab32977-826e-45fa-8904-54dd32ee0544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.440760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab32977-826e-45fa-8904-54dd32ee0544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.442415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab32977-826e-45fa-8904-54dd32ee0544 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.446211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1073/2140] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:37.450178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d302c5-73c1-4407-ba7a-ef4f150d82a7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.453423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1068/2141] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:37.457346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab32977-826e-45fa-8904-54dd32ee0544 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.459982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d302c5-73c1-4407-ba7a-ef4f150d82a7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.464804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.465403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.465678 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.465945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.466596 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:37.466924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.467580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab32977-826e-45fa-8904-54dd32ee0544 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.468532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.470094 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:37.472946 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6e43-567b-4bc8-b676-e0488ddde27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.473592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6e43-567b-4bc8-b676-e0488ddde27f admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.473868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6e43-567b-4bc8-b676-e0488ddde27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.474170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6e43-567b-4bc8-b676-e0488ddde27f admin admin] PATH_INFO: `/v3/projects/79f72a2145e64c798d23554619dcd25c/users/caf2399be98f488eb963bd8318e04bd0/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.486235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1074/2142] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:37.489032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.490777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:37.492092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc6e43-567b-4bc8-b676-e0488ddde27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f72a2145e64c798d23554619dcd25c, user_id=caf2399be98f488eb963bd8318e04bd0, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.494780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc6e43-567b-4bc8-b676-e0488ddde27f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.508738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1069/2143] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:37 2022] PUT /identity/v3/projects/79f72a2145e64c798d23554619dcd25c/users/caf2399be98f488eb963bd8318e04bd0/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:37.518457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6e43-567b-4bc8-b676-e0488ddde27f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.552787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac8f31-f8af-4a45-9ec2-8e6a33ffc5de admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.578187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6e43-567b-4bc8-b676-e0488ddde27f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.583422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaa158-1585-48d8-9cb2-beda53b9e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.584020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa158-1585-48d8-9cb2-beda53b9e2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.584294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa158-1585-48d8-9cb2-beda53b9e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.584558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa158-1585-48d8-9cb2-beda53b9e2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.585171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaa158-1585-48d8-9cb2-beda53b9e2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.587198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaa158-1585-48d8-9cb2-beda53b9e2c1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.605836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736475e-2a65-40e0-a4d2-f74a9e5b6b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.606454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736475e-2a65-40e0-a4d2-f74a9e5b6b43 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.606791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736475e-2a65-40e0-a4d2-f74a9e5b6b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.607068 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736475e-2a65-40e0-a4d2-f74a9e5b6b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.617643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736475e-2a65-40e0-a4d2-f74a9e5b6b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.618250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1070/2144] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:37.619764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b56c00-bf00-435c-a5ec-e516caddb0b5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.619880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b56c00-bf00-435c-a5ec-e516caddb0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.620106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b56c00-bf00-435c-a5ec-e516caddb0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.623302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736475e-2a65-40e0-a4d2-f74a9e5b6b43 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.645816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1075/2145] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:37.646812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736475e-2a65-40e0-a4d2-f74a9e5b6b43 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.655528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e0b56c00-bf00-435c-a5ec-e516caddb0b5 None None] MFA Rules not processed for user `caf2399be98f488eb963bd8318e04bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:37.656863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e0b56c00-bf00-435c-a5ec-e516caddb0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:37.669524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736475e-2a65-40e0-a4d2-f74a9e5b6b43 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.779024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e4f79-696c-4404-a918-ef2feffb4dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.779905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4f79-696c-4404-a918-ef2feffb4dae admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.780200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4f79-696c-4404-a918-ef2feffb4dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.780472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4f79-696c-4404-a918-ef2feffb4dae admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.781123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e4f79-696c-4404-a918-ef2feffb4dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.783154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e4f79-696c-4404-a918-ef2feffb4dae admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.805028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1071/2146] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:37.806539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b56c00-bf00-435c-a5ec-e516caddb0b5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.822620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b56c00-bf00-435c-a5ec-e516caddb0b5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.828677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4502b82-9fdd-404d-9f5b-fb1ed6e1582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.829786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4502b82-9fdd-404d-9f5b-fb1ed6e1582a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.830102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4502b82-9fdd-404d-9f5b-fb1ed6e1582a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.830477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4502b82-9fdd-404d-9f5b-fb1ed6e1582a admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.831239 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4502b82-9fdd-404d-9f5b-fb1ed6e1582a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.831854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1076/2147] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:37.832908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e4f79-696c-4404-a918-ef2feffb4dae admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.833076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4502b82-9fdd-404d-9f5b-fb1ed6e1582a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.838014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:37.846245 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e4f79-696c-4404-a918-ef2feffb4dae admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.853115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0728-38a1-4eeb-b456-ddc26752f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.853742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0728-38a1-4eeb-b456-ddc26752f38f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.854024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0728-38a1-4eeb-b456-ddc26752f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.854303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0728-38a1-4eeb-b456-ddc26752f38f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.855176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a0728-38a1-4eeb-b456-ddc26752f38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.857414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a0728-38a1-4eeb-b456-ddc26752f38f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.874793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1072/2148] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:37.878454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1077/2149] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:37.880371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0728-38a1-4eeb-b456-ddc26752f38f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.880510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4502b82-9fdd-404d-9f5b-fb1ed6e1582a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.893381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0728-38a1-4eeb-b456-ddc26752f38f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.931425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:37.949482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4502b82-9fdd-404d-9f5b-fb1ed6e1582a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.955373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcea3ed-68ac-4ed5-9ac8-58a47d63f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.956271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcea3ed-68ac-4ed5-9ac8-58a47d63f178 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.956496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcea3ed-68ac-4ed5-9ac8-58a47d63f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.956777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcea3ed-68ac-4ed5-9ac8-58a47d63f178 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.957416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcea3ed-68ac-4ed5-9ac8-58a47d63f178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.959396 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcea3ed-68ac-4ed5-9ac8-58a47d63f178 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.983616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1073/2150] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:37 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:37.985106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26d71b-76d1-43f8-8991-e4e2c41e6ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.985822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26d71b-76d1-43f8-8991-e4e2c41e6ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.986098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26d71b-76d1-43f8-8991-e4e2c41e6ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.986423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26d71b-76d1-43f8-8991-e4e2c41e6ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.987730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26d71b-76d1-43f8-8991-e4e2c41e6ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.988555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcea3ed-68ac-4ed5-9ac8-58a47d63f178 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.989603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26d71b-76d1-43f8-8991-e4e2c41e6ac8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.000068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcea3ed-68ac-4ed5-9ac8-58a47d63f178 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.004475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1078/2151] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:38.004475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26d71b-76d1-43f8-8991-e4e2c41e6ac8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.004475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b26d71b-76d1-43f8-8991-e4e2c41e6ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.008063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e8d02-059c-4a25-b75c-869915e7afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.008680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e8d02-059c-4a25-b75c-869915e7afd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.008984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e8d02-059c-4a25-b75c-869915e7afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.009219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e8d02-059c-4a25-b75c-869915e7afd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.009885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e8d02-059c-4a25-b75c-869915e7afd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.011633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e8d02-059c-4a25-b75c-869915e7afd4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.019692 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26d71b-76d1-43f8-8991-e4e2c41e6ac8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.024696 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.025341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.025626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.026041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] PATH_INFO: `/v3/projects/0ee6202daeda471c97eb2b367bc82e9d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.027267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee6202daeda471c97eb2b367bc82e9d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.029197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.031046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1074/2152] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:38.031920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e8d02-059c-4a25-b75c-869915e7afd4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.042204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e8d02-059c-4a25-b75c-869915e7afd4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.047143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f1b7-fedd-4819-bae5-097fe9278a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.047786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f1b7-fedd-4819-bae5-097fe9278a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.048062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f1b7-fedd-4819-bae5-097fe9278a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.048485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f1b7-fedd-4819-bae5-097fe9278a2c admin admin] PATH_INFO: `/v3/projects/29c75446202c4c69b9933072e2e682b0/users/aea496a6f526433d8c95dfed13fcf633/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.065243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f1b7-fedd-4819-bae5-097fe9278a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c75446202c4c69b9933072e2e682b0, user_id=aea496a6f526433d8c95dfed13fcf633, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.068017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f1b7-fedd-4819-bae5-097fe9278a2c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.079138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee6202daeda471c97eb2b367bc82e9d', 'request_id': 'req-f409d63a-6ec9-4b84-b39d-5f6390aa8832'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.083625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1075/2153] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:38 2022] PUT /identity/v3/projects/29c75446202c4c69b9933072e2e682b0/users/aea496a6f526433d8c95dfed13fcf633/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:38.084707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f1b7-fedd-4819-bae5-097fe9278a2c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.094452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee6202daeda471c97eb2b367bc82e9d', 'request_id': 'req-f409d63a-6ec9-4b84-b39d-5f6390aa8832'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.101067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee6202daeda471c97eb2b367bc82e9d', 'request_id': 'req-f409d63a-6ec9-4b84-b39d-5f6390aa8832'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.113604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] The token cache is being invalidate because project 0ee6202daeda471c97eb2b367bc82e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:38.113891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.114547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f409d63a-6ec9-4b84-b39d-5f6390aa8832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.116092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1079/2154] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:38 2022] DELETE /identity/v3/projects/0ee6202daeda471c97eb2b367bc82e9d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:38.117867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea918b-16fb-4784-9e4f-b5859520c598 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.118154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea918b-16fb-4784-9e4f-b5859520c598 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.118574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea918b-16fb-4784-9e4f-b5859520c598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.145968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f3ea918b-16fb-4784-9e4f-b5859520c598 None None] MFA Rules not processed for user `aea496a6f526433d8c95dfed13fcf633`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:38.147221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f3ea918b-16fb-4784-9e4f-b5859520c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.149966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f1b7-fedd-4819-bae5-097fe9278a2c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.154637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a276e3-bd13-459d-be6e-86ecb42acd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.155333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a276e3-bd13-459d-be6e-86ecb42acd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.155613 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a276e3-bd13-459d-be6e-86ecb42acd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.155879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a276e3-bd13-459d-be6e-86ecb42acd30 admin admin] PATH_INFO: `/v3/projects/ef35cf4187dc4831bec403f710929ad2/users/f74480024bcc4e7caa0687827abf938f/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.170868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a276e3-bd13-459d-be6e-86ecb42acd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef35cf4187dc4831bec403f710929ad2, user_id=f74480024bcc4e7caa0687827abf938f, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.173547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a276e3-bd13-459d-be6e-86ecb42acd30 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.189827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1076/2155] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:38 2022] PUT /identity/v3/projects/ef35cf4187dc4831bec403f710929ad2/users/f74480024bcc4e7caa0687827abf938f/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:38.191526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a276e3-bd13-459d-be6e-86ecb42acd30 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.193386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a2a276e3-bd13-459d-be6e-86ecb42acd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.213512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1080/2156] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:38.217774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea918b-16fb-4784-9e4f-b5859520c598 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.219172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f3ea918b-16fb-4784-9e4f-b5859520c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.219770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:38.234134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea918b-16fb-4784-9e4f-b5859520c598 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.262694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a276e3-bd13-459d-be6e-86ecb42acd30 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.267468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.268154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.268427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.268700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] PATH_INFO: `/v3/users/2e2f91aa00ed4270a2394748a8e6e081` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.269893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2f91aa00ed4270a2394748a8e6e081)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.271851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.274953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:38.296765 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61009d95-f53c-49bb-ae14-59f6a2e5e7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.297381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61009d95-f53c-49bb-ae14-59f6a2e5e7eb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.297664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61009d95-f53c-49bb-ae14-59f6a2e5e7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.297942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61009d95-f53c-49bb-ae14-59f6a2e5e7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.298589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61009d95-f53c-49bb-ae14-59f6a2e5e7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.301106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61009d95-f53c-49bb-ae14-59f6a2e5e7eb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.311240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1081/2157] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:38.312058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61009d95-f53c-49bb-ae14-59f6a2e5e7eb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.313737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-61009d95-f53c-49bb-ae14-59f6a2e5e7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.325001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2f91aa00ed4270a2394748a8e6e081'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.340535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2f91aa00ed4270a2394748a8e6e081'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.341494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2f91aa00ed4270a2394748a8e6e081'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.360454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2f91aa00ed4270a2394748a8e6e081'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.369376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2f91aa00ed4270a2394748a8e6e081'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.376481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1077/2158] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:38 2022] DELETE /identity/v3/users/2e2f91aa00ed4270a2394748a8e6e081 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:38.377340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.381535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.383680 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61009d95-f53c-49bb-ae14-59f6a2e5e7eb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.459605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.460602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.460732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.460896 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.463350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.476577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ffd17-1e08-44f7-84f5-4ca5d3fe8812 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.484203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a88e37-5e16-4ef7-b192-1ca452406195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.484203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88e37-5e16-4ef7-b192-1ca452406195 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.484801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88e37-5e16-4ef7-b192-1ca452406195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.485583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88e37-5e16-4ef7-b192-1ca452406195 admin admin] PATH_INFO: `/v3/projects/ef35cf4187dc4831bec403f710929ad2/users/f74480024bcc4e7caa0687827abf938f/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.487686 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a88e37-5e16-4ef7-b192-1ca452406195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef35cf4187dc4831bec403f710929ad2, user_id=f74480024bcc4e7caa0687827abf938f, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.490869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a88e37-5e16-4ef7-b192-1ca452406195 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.506480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1078/2159] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:38 2022] PUT /identity/v3/projects/ef35cf4187dc4831bec403f710929ad2/users/f74480024bcc4e7caa0687827abf938f/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:38.519512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141b83-a446-4f03-9336-76a7e1f376e4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.520658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141b83-a446-4f03-9336-76a7e1f376e4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.522037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141b83-a446-4f03-9336-76a7e1f376e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.537913 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.540137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.550555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1082/2160] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:38.564177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1c141b83-a446-4f03-9336-76a7e1f376e4 None None] MFA Rules not processed for user `f74480024bcc4e7caa0687827abf938f`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:38.565422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1c141b83-a446-4f03-9336-76a7e1f376e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.593283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:38.660676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1079/2161] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:38.672052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.673808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.686714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844ae40-223a-47b9-948f-3f7f923e8a85 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.745925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:38.752894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19027083-890d-4178-9e4e-bc6c5079065a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.753660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027083-890d-4178-9e4e-bc6c5079065a service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.753941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027083-890d-4178-9e4e-bc6c5079065a service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.754218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027083-890d-4178-9e4e-bc6c5079065a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.756139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-19027083-890d-4178-9e4e-bc6c5079065a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.791926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141b83-a446-4f03-9336-76a7e1f376e4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.793513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1c141b83-a446-4f03-9336-76a7e1f376e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.834477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19027083-890d-4178-9e4e-bc6c5079065a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.836144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19027083-890d-4178-9e4e-bc6c5079065a service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.848296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1083/2162] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:38.922771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141b83-a446-4f03-9336-76a7e1f376e4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.928991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.929909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.930213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.930491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] PATH_INFO: `/v3/projects/7feb65b27620424fb442eda5ed92bbd5` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.931771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7feb65b27620424fb442eda5ed92bbd5)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.933882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.012241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7feb65b27620424fb442eda5ed92bbd5', 'request_id': 'req-1283b3b0-1d18-4ef7-8230-ef361e00506b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:39.027475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7feb65b27620424fb442eda5ed92bbd5', 'request_id': 'req-1283b3b0-1d18-4ef7-8230-ef361e00506b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:39.039245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7feb65b27620424fb442eda5ed92bbd5', 'request_id': 'req-1283b3b0-1d18-4ef7-8230-ef361e00506b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:39.058444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] The token cache is being invalidate because project 7feb65b27620424fb442eda5ed92bbd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:39.058917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:39.059703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1283b3b0-1d18-4ef7-8230-ef361e00506b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:39.061369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1080/2163] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:38 2022] DELETE /identity/v3/projects/7feb65b27620424fb442eda5ed92bbd5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:39.066449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a1c91-3520-45f0-96cb-6d6dc1b7fa8b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.067578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a1c91-3520-45f0-96cb-6d6dc1b7fa8b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.067894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a1c91-3520-45f0-96cb-6d6dc1b7fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.091597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8c2a1c91-3520-45f0-96cb-6d6dc1b7fa8b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:39.092852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8c2a1c91-3520-45f0-96cb-6d6dc1b7fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:39.175731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c75d8-6d9f-4be9-a8c7-e858319f1b79 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.175731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c75d8-6d9f-4be9-a8c7-e858319f1b79 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.175960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c75d8-6d9f-4be9-a8c7-e858319f1b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.181000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1084/2164] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:39.206196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-903c75d8-6d9f-4be9-a8c7-e858319f1b79 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:39.207891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-903c75d8-6d9f-4be9-a8c7-e858319f1b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:39.217943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1081/2165] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:39.222812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a1c91-3520-45f0-96cb-6d6dc1b7fa8b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.239523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a1c91-3520-45f0-96cb-6d6dc1b7fa8b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.245259 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d4ebc-67ce-4ff4-af9c-cf7b02c10463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.245949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d4ebc-67ce-4ff4-af9c-cf7b02c10463 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.246780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d4ebc-67ce-4ff4-af9c-cf7b02c10463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.246780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d4ebc-67ce-4ff4-af9c-cf7b02c10463 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.247251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d4ebc-67ce-4ff4-af9c-cf7b02c10463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:39.247719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d4ebc-67ce-4ff4-af9c-cf7b02c10463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.250209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d4ebc-67ce-4ff4-af9c-cf7b02c10463 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.270116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1085/2166] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:39.274755 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c75d8-6d9f-4be9-a8c7-e858319f1b79 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.293732 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c75d8-6d9f-4be9-a8c7-e858319f1b79 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.303362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b99be-a5d4-4030-a0be-0a9119d40c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.303981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b99be-a5d4-4030-a0be-0a9119d40c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.304254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b99be-a5d4-4030-a0be-0a9119d40c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.304518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b99be-a5d4-4030-a0be-0a9119d40c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.305159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b99be-a5d4-4030-a0be-0a9119d40c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.307234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b99be-a5d4-4030-a0be-0a9119d40c81 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.354474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1082/2167] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:39 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:39.363827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d4ebc-67ce-4ff4-af9c-cf7b02c10463 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.379009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d4ebc-67ce-4ff4-af9c-cf7b02c10463 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.441405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5a7e1-eb44-4ebb-8a5d-735674b15de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.442396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5a7e1-eb44-4ebb-8a5d-735674b15de9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.442396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5a7e1-eb44-4ebb-8a5d-735674b15de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.442590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5a7e1-eb44-4ebb-8a5d-735674b15de9 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.443108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5a7e1-eb44-4ebb-8a5d-735674b15de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.445276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5a7e1-eb44-4ebb-8a5d-735674b15de9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.468361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1086/2168] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:39 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:39.472494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b99be-a5d4-4030-a0be-0a9119d40c81 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.483239 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b99be-a5d4-4030-a0be-0a9119d40c81 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.489069 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15cf60-78cf-44ab-a1eb-8462d25741e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.489672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15cf60-78cf-44ab-a1eb-8462d25741e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.489950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15cf60-78cf-44ab-a1eb-8462d25741e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.490218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15cf60-78cf-44ab-a1eb-8462d25741e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.490882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15cf60-78cf-44ab-a1eb-8462d25741e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.492516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15cf60-78cf-44ab-a1eb-8462d25741e4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.503487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1083/2169] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:39.507521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5a7e1-eb44-4ebb-8a5d-735674b15de9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.517421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5a7e1-eb44-4ebb-8a5d-735674b15de9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.522190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d46ad-d7c4-485c-9542-b57b03fb0127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.522821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d46ad-d7c4-485c-9542-b57b03fb0127 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.523175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d46ad-d7c4-485c-9542-b57b03fb0127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.523574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d46ad-d7c4-485c-9542-b57b03fb0127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.524307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d46ad-d7c4-485c-9542-b57b03fb0127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.525941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d46ad-d7c4-485c-9542-b57b03fb0127 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.536685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1087/2170] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:39.541021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15cf60-78cf-44ab-a1eb-8462d25741e4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.551439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15cf60-78cf-44ab-a1eb-8462d25741e4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.556086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cf9cd-434c-407c-9b62-9173084cf540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.556733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cf9cd-434c-407c-9b62-9173084cf540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.557012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cf9cd-434c-407c-9b62-9173084cf540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.557284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cf9cd-434c-407c-9b62-9173084cf540 admin admin] PATH_INFO: `/v3/projects/2f2edd9106724cda9d5958ed7cd2ffe5/users/351875cfbfc44edc92145ac4e3f96b1a/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.566934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:39.574696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cf9cd-434c-407c-9b62-9173084cf540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2edd9106724cda9d5958ed7cd2ffe5, user_id=351875cfbfc44edc92145ac4e3f96b1a, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.577724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cf9cd-434c-407c-9b62-9173084cf540 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.592408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1084/2171] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:39 2022] PUT /identity/v3/projects/2f2edd9106724cda9d5958ed7cd2ffe5/users/351875cfbfc44edc92145ac4e3f96b1a/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:39.597954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993063b-7fa3-418f-993f-7a5b3cc31bdd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.598241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993063b-7fa3-418f-993f-7a5b3cc31bdd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.598518 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993063b-7fa3-418f-993f-7a5b3cc31bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.613082 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:39.619710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9993063b-7fa3-418f-993f-7a5b3cc31bdd None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:39.621613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9993063b-7fa3-418f-993f-7a5b3cc31bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:39.684649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1088/2172] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:39.694431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cf9cd-434c-407c-9b62-9173084cf540 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.697085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-954cf9cd-434c-407c-9b62-9173084cf540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:39.756175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cf9cd-434c-407c-9b62-9173084cf540 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.759840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c960e-38c7-445a-96eb-736471803199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.760448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c960e-38c7-445a-96eb-736471803199 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.760759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c960e-38c7-445a-96eb-736471803199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.761031 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c960e-38c7-445a-96eb-736471803199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.769841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c960e-38c7-445a-96eb-736471803199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.771313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c960e-38c7-445a-96eb-736471803199 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.780583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1085/2173] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:40.451984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ba5b8-c0b7-495a-9c3b-5b141dcce38f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.452326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ba5b8-c0b7-495a-9c3b-5b141dcce38f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.452610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ba5b8-c0b7-495a-9c3b-5b141dcce38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.486025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0e4ba5b8-c0b7-495a-9c3b-5b141dcce38f None None] MFA Rules not processed for user `351875cfbfc44edc92145ac4e3f96b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:40.488322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0e4ba5b8-c0b7-495a-9c3b-5b141dcce38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:40.582959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1089/2174] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:40.583294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c960e-38c7-445a-96eb-736471803199 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:40.598765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c960e-38c7-445a-96eb-736471803199 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:40.604434 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236dc7d-a979-4436-bea1-a0a45b4729ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:40.605076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236dc7d-a979-4436-bea1-a0a45b4729ae admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.605476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236dc7d-a979-4436-bea1-a0a45b4729ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.605630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236dc7d-a979-4436-bea1-a0a45b4729ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.606340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236dc7d-a979-4436-bea1-a0a45b4729ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:40.608349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236dc7d-a979-4436-bea1-a0a45b4729ae admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.642218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1086/2175] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:40 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:40.644279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ba5b8-c0b7-495a-9c3b-5b141dcce38f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:40.655560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ba5b8-c0b7-495a-9c3b-5b141dcce38f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:40.716128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e549e1-c4c8-47b6-96b1-502a3fcd569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:40.716741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e549e1-c4c8-47b6-96b1-502a3fcd569c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.717025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e549e1-c4c8-47b6-96b1-502a3fcd569c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.717302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e549e1-c4c8-47b6-96b1-502a3fcd569c admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.717961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e549e1-c4c8-47b6-96b1-502a3fcd569c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:40.719977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e549e1-c4c8-47b6-96b1-502a3fcd569c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.740851 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1090/2176] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:40 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:40.744693 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236dc7d-a979-4436-bea1-a0a45b4729ae admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:40.755427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236dc7d-a979-4436-bea1-a0a45b4729ae admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:40.760271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77227e56-db1a-42eb-bbc7-40ba4754aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:40.761112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77227e56-db1a-42eb-bbc7-40ba4754aef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.761225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77227e56-db1a-42eb-bbc7-40ba4754aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.761435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77227e56-db1a-42eb-bbc7-40ba4754aef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.762072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77227e56-db1a-42eb-bbc7-40ba4754aef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:40.763786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77227e56-db1a-42eb-bbc7-40ba4754aef7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.775814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1087/2177] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:40.780247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e549e1-c4c8-47b6-96b1-502a3fcd569c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:40.792525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e549e1-c4c8-47b6-96b1-502a3fcd569c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:40.797331 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bce8ba-7521-40cb-b0fc-4f993b66ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:40.798000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bce8ba-7521-40cb-b0fc-4f993b66ae45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.798357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bce8ba-7521-40cb-b0fc-4f993b66ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.798718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bce8ba-7521-40cb-b0fc-4f993b66ae45 admin admin] PATH_INFO: `/v3/projects/b3cff150770543f0abbbf97fa3cba488/users/e02116493a26428eae89102496e4913e/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.814990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bce8ba-7521-40cb-b0fc-4f993b66ae45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cff150770543f0abbbf97fa3cba488, user_id=e02116493a26428eae89102496e4913e, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:40.817747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bce8ba-7521-40cb-b0fc-4f993b66ae45 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.832261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1091/2178] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:40 2022] PUT /identity/v3/projects/b3cff150770543f0abbbf97fa3cba488/users/e02116493a26428eae89102496e4913e/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:40.836473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77227e56-db1a-42eb-bbc7-40ba4754aef7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:40.848409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77227e56-db1a-42eb-bbc7-40ba4754aef7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:40.906338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b64bf-28ed-41ca-8eee-4fdbab8ea97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:40.906981 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b64bf-28ed-41ca-8eee-4fdbab8ea97d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.907257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b64bf-28ed-41ca-8eee-4fdbab8ea97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.907527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b64bf-28ed-41ca-8eee-4fdbab8ea97d admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.908171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b64bf-28ed-41ca-8eee-4fdbab8ea97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:40.910625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b64bf-28ed-41ca-8eee-4fdbab8ea97d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.920642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1088/2179] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:40.924755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bce8ba-7521-40cb-b0fc-4f993b66ae45 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:40.930202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:40.936256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bce8ba-7521-40cb-b0fc-4f993b66ae45 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:40.941321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa468-533b-4144-8565-8441ee94bdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:40.941972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa468-533b-4144-8565-8441ee94bdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.942251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa468-533b-4144-8565-8441ee94bdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.942524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa468-533b-4144-8565-8441ee94bdb4 admin admin] PATH_INFO: `/v3/projects/b3cff150770543f0abbbf97fa3cba488/users/e02116493a26428eae89102496e4913e/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.944544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6aa468-533b-4144-8565-8441ee94bdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cff150770543f0abbbf97fa3cba488, user_id=e02116493a26428eae89102496e4913e, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:40.947229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6aa468-533b-4144-8565-8441ee94bdb4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.958707 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1092/2180] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:40 2022] PUT /identity/v3/projects/b3cff150770543f0abbbf97fa3cba488/users/e02116493a26428eae89102496e4913e/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:41.644930 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e6b90-026d-47ad-ad98-3c83bc67cc64 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:41.645462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e6b90-026d-47ad-ad98-3c83bc67cc64 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:41.645462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e6b90-026d-47ad-ad98-3c83bc67cc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:41.652293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa468-533b-4144-8565-8441ee94bdb4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:41.653413 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3b6aa468-533b-4144-8565-8441ee94bdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:41.676163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5c2e6b90-026d-47ad-ad98-3c83bc67cc64 None None] MFA Rules not processed for user `e02116493a26428eae89102496e4913e`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:41.677553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5c2e6b90-026d-47ad-ad98-3c83bc67cc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:41.729667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:41.737743 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa468-533b-4144-8565-8441ee94bdb4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:41.741527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:41.742137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:41.742518 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:41.742858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:41.744637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:41.773802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1089/2181] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:41.775749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c6691-b4c6-4e0d-a30e-2aa91dab8b86 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:41.776044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c6691-b4c6-4e0d-a30e-2aa91dab8b86 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:41.776351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c6691-b4c6-4e0d-a30e-2aa91dab8b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:41.807590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-dd4c6691-b4c6-4e0d-a30e-2aa91dab8b86 None None] MFA Rules not processed for user `351875cfbfc44edc92145ac4e3f96b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:41.809123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dd4c6691-b4c6-4e0d-a30e-2aa91dab8b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:41.828685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:41.831088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:41.844821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1093/2182] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:41.867770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1090/2183] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:41.879270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:41.880814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:41.972092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61119b-9063-4dcb-b03e-58a9448deee4 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:41.979426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e255f-d00e-4698-aadd-cb10b3024fd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:41.980158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e255f-d00e-4698-aadd-cb10b3024fd9 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:41.980439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e255f-d00e-4698-aadd-cb10b3024fd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:41.980710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e255f-d00e-4698-aadd-cb10b3024fd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:41.991394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e255f-d00e-4698-aadd-cb10b3024fd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:41.994890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e255f-d00e-4698-aadd-cb10b3024fd9 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:42.007249 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1094/2184] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:48.993160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c6691-b4c6-4e0d-a30e-2aa91dab8b86 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:48.994605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dd4c6691-b4c6-4e0d-a30e-2aa91dab8b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:49.071022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c6691-b4c6-4e0d-a30e-2aa91dab8b86 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:49.075543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:49.076175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:49.076451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:49.076746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] PATH_INFO: `/v3/users/aea496a6f526433d8c95dfed13fcf633` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:49.078007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea496a6f526433d8c95dfed13fcf633)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:49.080320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:49.132934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea496a6f526433d8c95dfed13fcf633'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.140455 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea496a6f526433d8c95dfed13fcf633'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.141089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea496a6f526433d8c95dfed13fcf633'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.153679 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea496a6f526433d8c95dfed13fcf633'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.162275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea496a6f526433d8c95dfed13fcf633'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.169194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1091/2185] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:48 2022] DELETE /identity/v3/users/aea496a6f526433d8c95dfed13fcf633 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:49.173946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b909dd5-c430-404e-a024-3c0f414776b7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:49.175750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b909dd5-c430-404e-a024-3c0f414776b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:49.176036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b909dd5-c430-404e-a024-3c0f414776b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:49.195322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0b909dd5-c430-404e-a024-3c0f414776b7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:49.196632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b909dd5-c430-404e-a024-3c0f414776b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:49.217233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:49.264480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1095/2186] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:49.274301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:49.275793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:49.281128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:49.336499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751a986-3526-4266-9eaa-9e4c5db8da5c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:49.340106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac084f46-d97b-4b85-8fa1-b79a1fc1d3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:49.340701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac084f46-d97b-4b85-8fa1-b79a1fc1d3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:49.340972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac084f46-d97b-4b85-8fa1-b79a1fc1d3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:49.341238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac084f46-d97b-4b85-8fa1-b79a1fc1d3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:49.350570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac084f46-d97b-4b85-8fa1-b79a1fc1d3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:49.352015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac084f46-d97b-4b85-8fa1-b79a1fc1d3d7 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:49.361846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1092/2187] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:49.646251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b909dd5-c430-404e-a024-3c0f414776b7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:49.647903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b909dd5-c430-404e-a024-3c0f414776b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:49.662923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b909dd5-c430-404e-a024-3c0f414776b7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:49.679484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:49.680368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:49.680914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:49.681191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] PATH_INFO: `/v3/projects/29c75446202c4c69b9933072e2e682b0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:49.682381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c75446202c4c69b9933072e2e682b0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:49.684365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:49.780971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c75446202c4c69b9933072e2e682b0', 'request_id': 'req-9840b81d-7bc4-418c-97dc-910462f64487'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.792167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c75446202c4c69b9933072e2e682b0', 'request_id': 'req-9840b81d-7bc4-418c-97dc-910462f64487'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.800218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c75446202c4c69b9933072e2e682b0', 'request_id': 'req-9840b81d-7bc4-418c-97dc-910462f64487'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.813847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] The token cache is being invalidate because project 29c75446202c4c69b9933072e2e682b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:49.814362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.815416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9840b81d-7bc4-418c-97dc-910462f64487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:49.817304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1096/2188] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:49 2022] DELETE /identity/v3/projects/29c75446202c4c69b9933072e2e682b0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:54.626331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac084f46-d97b-4b85-8fa1-b79a1fc1d3d7 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:54.627920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ac084f46-d97b-4b85-8fa1-b79a1fc1d3d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:54.641012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac084f46-d97b-4b85-8fa1-b79a1fc1d3d7 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:54.707412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:54.708044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:54.708319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:54.708585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] PATH_INFO: `/v3/users/caf2399be98f488eb963bd8318e04bd0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:54.709966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf2399be98f488eb963bd8318e04bd0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:54.711910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:54.768018 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf2399be98f488eb963bd8318e04bd0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.777184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf2399be98f488eb963bd8318e04bd0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.777869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf2399be98f488eb963bd8318e04bd0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.792172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf2399be98f488eb963bd8318e04bd0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.804016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf2399be98f488eb963bd8318e04bd0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.811023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1093/2189] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:54 2022] DELETE /identity/v3/users/caf2399be98f488eb963bd8318e04bd0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:54.815381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33f91f-6c9b-4646-8860-bd16333d70a4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:54.815867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33f91f-6c9b-4646-8860-bd16333d70a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:54.815957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33f91f-6c9b-4646-8860-bd16333d70a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:54.837170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ec33f91f-6c9b-4646-8860-bd16333d70a4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:54.838492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec33f91f-6c9b-4646-8860-bd16333d70a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:54.919902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1097/2190] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:54.931289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:54.936000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:54.982987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:55.014295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab037ea-3cd0-4f03-bb67-297f1d024209 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:55.018198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aab1e7-bf57-4752-b7e6-7daf878873bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:55.019359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aab1e7-bf57-4752-b7e6-7daf878873bf service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:55.019632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aab1e7-bf57-4752-b7e6-7daf878873bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:55.020049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aab1e7-bf57-4752-b7e6-7daf878873bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:55.031708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aab1e7-bf57-4752-b7e6-7daf878873bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:55.033148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aab1e7-bf57-4752-b7e6-7daf878873bf service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:55.043817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1094/2191] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:55.319092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33f91f-6c9b-4646-8860-bd16333d70a4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:55.320535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec33f91f-6c9b-4646-8860-bd16333d70a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:55.333397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33f91f-6c9b-4646-8860-bd16333d70a4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:55.343553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:55.344286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:55.344464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:55.344751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] PATH_INFO: `/v3/projects/79f72a2145e64c798d23554619dcd25c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:55.346124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f72a2145e64c798d23554619dcd25c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:55.348722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:55.393300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:55.398102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f72a2145e64c798d23554619dcd25c', 'request_id': 'req-d7c2e975-245a-40cf-925b-15bcc4a93d34'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.405753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f72a2145e64c798d23554619dcd25c', 'request_id': 'req-d7c2e975-245a-40cf-925b-15bcc4a93d34'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.411400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f72a2145e64c798d23554619dcd25c', 'request_id': 'req-d7c2e975-245a-40cf-925b-15bcc4a93d34'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.425193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] The token cache is being invalidate because project 79f72a2145e64c798d23554619dcd25c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:55.425528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.426169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.427714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1098/2192] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:55 2022] DELETE /identity/v3/projects/79f72a2145e64c798d23554619dcd25c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:55.431807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aab1e7-bf57-4752-b7e6-7daf878873bf service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:55.442180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aab1e7-bf57-4752-b7e6-7daf878873bf service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:55.501543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:55.502165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:55.502443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:55.503318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] PATH_INFO: `/v3/users/f74480024bcc4e7caa0687827abf938f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:55.504725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74480024bcc4e7caa0687827abf938f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:55.506638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:55.552054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74480024bcc4e7caa0687827abf938f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.562677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74480024bcc4e7caa0687827abf938f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.563307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74480024bcc4e7caa0687827abf938f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.575938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74480024bcc4e7caa0687827abf938f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.583372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-34560dba-b0ca-4b42-9730-5b07c014232e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74480024bcc4e7caa0687827abf938f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.589208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1095/2193] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:55 2022] DELETE /identity/v3/users/f74480024bcc4e7caa0687827abf938f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:55.868119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:55.869584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:55.885324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2e975-245a-40cf-925b-15bcc4a93d34 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:55.944773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:55.945447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:55.945801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:55.946192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] PATH_INFO: `/v3/projects/ef35cf4187dc4831bec403f710929ad2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:55.947419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef35cf4187dc4831bec403f710929ad2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:55.949367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.011400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef35cf4187dc4831bec403f710929ad2', 'request_id': 'req-c01946c3-14dc-410b-ae76-ab529e13819c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.020948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef35cf4187dc4831bec403f710929ad2', 'request_id': 'req-c01946c3-14dc-410b-ae76-ab529e13819c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.029139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef35cf4187dc4831bec403f710929ad2', 'request_id': 'req-c01946c3-14dc-410b-ae76-ab529e13819c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.042898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] The token cache is being invalidate because project ef35cf4187dc4831bec403f710929ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:56.043188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.043844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c01946c3-14dc-410b-ae76-ab529e13819c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.045555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1099/2194] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:55 2022] DELETE /identity/v3/projects/ef35cf4187dc4831bec403f710929ad2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:56.050346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe0f6-0cdd-4ce7-976a-a8e69801936c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.050829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe0f6-0cdd-4ce7-976a-a8e69801936c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.050964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe0f6-0cdd-4ce7-976a-a8e69801936c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.076667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b1fbe0f6-0cdd-4ce7-976a-a8e69801936c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:56.077970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b1fbe0f6-0cdd-4ce7-976a-a8e69801936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:56.130989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:56.151123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1096/2195] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:56.160302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5645a-654b-497d-80a1-72be5052abe2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.160610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5645a-654b-497d-80a1-72be5052abe2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.160887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5645a-654b-497d-80a1-72be5052abe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.182186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cdf5645a-654b-497d-80a1-72be5052abe2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:56.183472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cdf5645a-654b-497d-80a1-72be5052abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:56.192060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1100/2196] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:56.196753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbe0f6-0cdd-4ce7-976a-a8e69801936c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.208044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbe0f6-0cdd-4ce7-976a-a8e69801936c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.212825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182dc8-21fd-441c-979c-5c5e19e4a33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.213464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182dc8-21fd-441c-979c-5c5e19e4a33d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.213744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182dc8-21fd-441c-979c-5c5e19e4a33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.214017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182dc8-21fd-441c-979c-5c5e19e4a33d admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.214667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182dc8-21fd-441c-979c-5c5e19e4a33d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:56.215032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182dc8-21fd-441c-979c-5c5e19e4a33d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.216640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182dc8-21fd-441c-979c-5c5e19e4a33d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.228445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1097/2197] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:56.233003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5645a-654b-497d-80a1-72be5052abe2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.242983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5645a-654b-497d-80a1-72be5052abe2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.248654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6a69b-1cfa-4520-87b6-037680a838dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.249297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6a69b-1cfa-4520-87b6-037680a838dc admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.249576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6a69b-1cfa-4520-87b6-037680a838dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.249848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6a69b-1cfa-4520-87b6-037680a838dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.250496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6a69b-1cfa-4520-87b6-037680a838dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.252448 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6a69b-1cfa-4520-87b6-037680a838dc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.282397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1101/2198] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:56.286535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182dc8-21fd-441c-979c-5c5e19e4a33d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.299880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182dc8-21fd-441c-979c-5c5e19e4a33d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.366186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548105c-7710-4b2f-8c70-17dc312971b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.366633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548105c-7710-4b2f-8c70-17dc312971b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.366976 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548105c-7710-4b2f-8c70-17dc312971b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.367252 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548105c-7710-4b2f-8c70-17dc312971b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.367925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548105c-7710-4b2f-8c70-17dc312971b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.369850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548105c-7710-4b2f-8c70-17dc312971b8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.398476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6a69b-1cfa-4520-87b6-037680a838dc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.399044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1098/2199] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:56.399869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548105c-7710-4b2f-8c70-17dc312971b8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.401718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9548105c-7710-4b2f-8c70-17dc312971b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:56.409598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6a69b-1cfa-4520-87b6-037680a838dc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.414585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8ae43-ccd3-4b04-9954-45ca7498968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.415297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8ae43-ccd3-4b04-9954-45ca7498968f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.415645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8ae43-ccd3-4b04-9954-45ca7498968f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.415992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8ae43-ccd3-4b04-9954-45ca7498968f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.416715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8ae43-ccd3-4b04-9954-45ca7498968f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.418416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8ae43-ccd3-4b04-9954-45ca7498968f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.430702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1102/2200] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:56.434425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8ae43-ccd3-4b04-9954-45ca7498968f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.445552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8ae43-ccd3-4b04-9954-45ca7498968f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.451610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57afcc-5998-4897-8f66-cd8a6ff7f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.452495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57afcc-5998-4897-8f66-cd8a6ff7f81a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.452824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57afcc-5998-4897-8f66-cd8a6ff7f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.453100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57afcc-5998-4897-8f66-cd8a6ff7f81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.453760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57afcc-5998-4897-8f66-cd8a6ff7f81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.455425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57afcc-5998-4897-8f66-cd8a6ff7f81a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.469125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548105c-7710-4b2f-8c70-17dc312971b8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.469347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1103/2201] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:56.470057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc2a9b-c72c-440b-a0f5-af567eab30a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.470661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57afcc-5998-4897-8f66-cd8a6ff7f81a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.470824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc2a9b-c72c-440b-a0f5-af567eab30a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.471030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc2a9b-c72c-440b-a0f5-af567eab30a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.471306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc2a9b-c72c-440b-a0f5-af567eab30a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.473332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-10fc2a9b-c72c-440b-a0f5-af567eab30a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:56.481525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57afcc-5998-4897-8f66-cd8a6ff7f81a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.488682 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87459d3c-efc3-4b4f-b06d-e5f061ea5409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.488682 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87459d3c-efc3-4b4f-b06d-e5f061ea5409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.488682 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87459d3c-efc3-4b4f-b06d-e5f061ea5409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.488682 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87459d3c-efc3-4b4f-b06d-e5f061ea5409 admin admin] PATH_INFO: `/v3/projects/3b72859b9265443ebad20862babc8966/users/6d0e86796d754d29833171627c876212/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.499087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:56.510610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87459d3c-efc3-4b4f-b06d-e5f061ea5409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b72859b9265443ebad20862babc8966, user_id=6d0e86796d754d29833171627c876212, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.513104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87459d3c-efc3-4b4f-b06d-e5f061ea5409 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.538126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1104/2202] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:56 2022] PUT /identity/v3/projects/3b72859b9265443ebad20862babc8966/users/6d0e86796d754d29833171627c876212/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:56.554337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809c13-ef95-415a-8b6b-6781edd9ac0b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.554651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809c13-ef95-415a-8b6b-6781edd9ac0b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.554999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809c13-ef95-415a-8b6b-6781edd9ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.570085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc2a9b-c72c-440b-a0f5-af567eab30a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.571724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc2a9b-c72c-440b-a0f5-af567eab30a3 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.582701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1099/2203] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:56.592247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fc809c13-ef95-415a-8b6b-6781edd9ac0b None None] MFA Rules not processed for user `6d0e86796d754d29833171627c876212`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:56.593485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc809c13-ef95-415a-8b6b-6781edd9ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:56.681180 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1105/2204] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:56.687159 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc2a9b-c72c-440b-a0f5-af567eab30a3 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.703911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc2a9b-c72c-440b-a0f5-af567eab30a3 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.715377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:56.780115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aea14d-7a92-41a1-8bd7-228ee20b7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.780727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aea14d-7a92-41a1-8bd7-228ee20b7fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.781004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aea14d-7a92-41a1-8bd7-228ee20b7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.781273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aea14d-7a92-41a1-8bd7-228ee20b7fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.781935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aea14d-7a92-41a1-8bd7-228ee20b7fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.784514 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aea14d-7a92-41a1-8bd7-228ee20b7fa2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.812785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1100/2205] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:56.817261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc809c13-ef95-415a-8b6b-6781edd9ac0b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.828492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc809c13-ef95-415a-8b6b-6781edd9ac0b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.885272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a1614-1309-464f-9bda-acd47e006d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.885927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a1614-1309-464f-9bda-acd47e006d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.886133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a1614-1309-464f-9bda-acd47e006d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.886419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a1614-1309-464f-9bda-acd47e006d75 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.887070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a1614-1309-464f-9bda-acd47e006d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.888985 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a1614-1309-464f-9bda-acd47e006d75 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.911360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1106/2206] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:56.915361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aea14d-7a92-41a1-8bd7-228ee20b7fa2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.926338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aea14d-7a92-41a1-8bd7-228ee20b7fa2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.930978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b66ce-5f53-41b1-b34b-90d074a323d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.931570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b66ce-5f53-41b1-b34b-90d074a323d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.931844 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b66ce-5f53-41b1-b34b-90d074a323d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.932107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b66ce-5f53-41b1-b34b-90d074a323d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.932745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b66ce-5f53-41b1-b34b-90d074a323d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.934332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b66ce-5f53-41b1-b34b-90d074a323d2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.945417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1101/2207] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:56.949638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a1614-1309-464f-9bda-acd47e006d75 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.960387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a1614-1309-464f-9bda-acd47e006d75 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.966019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c53874-14e6-4a22-9bda-0d0aebaca714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.966229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53874-14e6-4a22-9bda-0d0aebaca714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.966517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53874-14e6-4a22-9bda-0d0aebaca714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.966826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53874-14e6-4a22-9bda-0d0aebaca714 admin admin] PATH_INFO: `/v3/projects/654c4e0c784f4882bb4d7bb7227c8f00/users/a37c9104697b4fcabab09ed222f08293/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.984962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c53874-14e6-4a22-9bda-0d0aebaca714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654c4e0c784f4882bb4d7bb7227c8f00, user_id=a37c9104697b4fcabab09ed222f08293, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.988874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c53874-14e6-4a22-9bda-0d0aebaca714 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.005630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1107/2208] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:56 2022] PUT /identity/v3/projects/654c4e0c784f4882bb4d7bb7227c8f00/users/a37c9104697b4fcabab09ed222f08293/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:57.010108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b66ce-5f53-41b1-b34b-90d074a323d2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:57.020114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b66ce-5f53-41b1-b34b-90d074a323d2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:57.079654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a556243-c976-4009-af53-6f7da536ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:57.080754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a556243-c976-4009-af53-6f7da536ce5c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.080754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a556243-c976-4009-af53-6f7da536ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.081147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a556243-c976-4009-af53-6f7da536ce5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.082185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a556243-c976-4009-af53-6f7da536ce5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.083795 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a556243-c976-4009-af53-6f7da536ce5c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.094919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1102/2209] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:57.099753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c53874-14e6-4a22-9bda-0d0aebaca714 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:57.110306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c53874-14e6-4a22-9bda-0d0aebaca714 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:57.115754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dd5f5-6f8d-43be-9dd9-0417666a4298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:57.116403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dd5f5-6f8d-43be-9dd9-0417666a4298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.116684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dd5f5-6f8d-43be-9dd9-0417666a4298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.116960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dd5f5-6f8d-43be-9dd9-0417666a4298 admin admin] PATH_INFO: `/v3/projects/654c4e0c784f4882bb4d7bb7227c8f00/users/a37c9104697b4fcabab09ed222f08293/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.118908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dd5f5-6f8d-43be-9dd9-0417666a4298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654c4e0c784f4882bb4d7bb7227c8f00, user_id=a37c9104697b4fcabab09ed222f08293, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.121596 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dd5f5-6f8d-43be-9dd9-0417666a4298 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.132573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1108/2210] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:57 2022] PUT /identity/v3/projects/654c4e0c784f4882bb4d7bb7227c8f00/users/a37c9104697b4fcabab09ed222f08293/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:57.142767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec53cfc-decc-4a10-8431-f9fc1ab1a45d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.143058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec53cfc-decc-4a10-8431-f9fc1ab1a45d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.143367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec53cfc-decc-4a10-8431-f9fc1ab1a45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.178289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-eec53cfc-decc-4a10-8431-f9fc1ab1a45d None None] MFA Rules not processed for user `a37c9104697b4fcabab09ed222f08293`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:57.179535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-eec53cfc-decc-4a10-8431-f9fc1ab1a45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:57.268138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1103/2211] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:35:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:57.280474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dd5f5-6f8d-43be-9dd9-0417666a4298 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:57.282538 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-631dd5f5-6f8d-43be-9dd9-0417666a4298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:57.324661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:57.357161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dd5f5-6f8d-43be-9dd9-0417666a4298 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:57.361161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4c897-1b45-4b5b-935c-01f29680ab4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:57.361774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4c897-1b45-4b5b-935c-01f29680ab4b service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.362057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4c897-1b45-4b5b-935c-01f29680ab4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.362363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4c897-1b45-4b5b-935c-01f29680ab4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.427528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4c897-1b45-4b5b-935c-01f29680ab4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.428932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4c897-1b45-4b5b-935c-01f29680ab4b service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.438155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1109/2212] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:58.806352 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec53cfc-decc-4a10-8431-f9fc1ab1a45d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:58.816071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec53cfc-decc-4a10-8431-f9fc1ab1a45d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:58.819725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018215ae-6332-4280-a721-2f7265aad61a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:58.820323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018215ae-6332-4280-a721-2f7265aad61a service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:58.820601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018215ae-6332-4280-a721-2f7265aad61a service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:58.820873 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018215ae-6332-4280-a721-2f7265aad61a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:58.828046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:58.830555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018215ae-6332-4280-a721-2f7265aad61a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:58.833004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018215ae-6332-4280-a721-2f7265aad61a service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:58.843373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1104/2213] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:02.645917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4c897-1b45-4b5b-935c-01f29680ab4b service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:02.712120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4c897-1b45-4b5b-935c-01f29680ab4b service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:02.716726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:02.717355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:02.717635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:02.717909 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] PATH_INFO: `/v3/users/6d0e86796d754d29833171627c876212` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:02.719108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0e86796d754d29833171627c876212)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:02.721076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:02.765766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0e86796d754d29833171627c876212'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:02.777681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0e86796d754d29833171627c876212'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:02.785300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0e86796d754d29833171627c876212'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:02.792607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0e86796d754d29833171627c876212'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:02.793292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0e86796d754d29833171627c876212'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:02.800901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1110/2214] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:02 2022] DELETE /identity/v3/users/6d0e86796d754d29833171627c876212 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:36:02.805026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd6a21-049b-4556-a95a-fb841a2b2169 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:02.805567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd6a21-049b-4556-a95a-fb841a2b2169 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:02.805664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd6a21-049b-4556-a95a-fb841a2b2169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:02.826874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-75dd6a21-049b-4556-a95a-fb841a2b2169 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:02.828084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-75dd6a21-049b-4556-a95a-fb841a2b2169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:02.886657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1105/2215] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:02.896505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:02.897904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:02.903271 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:02.958232 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeaa04-1b21-44dd-8b61-7de999636d7e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:02.961945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643a07b-25cd-419f-ae89-50b97e14c114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:02.962553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643a07b-25cd-419f-ae89-50b97e14c114 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:02.962868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643a07b-25cd-419f-ae89-50b97e14c114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:02.963140 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643a07b-25cd-419f-ae89-50b97e14c114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:02.972544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643a07b-25cd-419f-ae89-50b97e14c114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:02.973992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643a07b-25cd-419f-ae89-50b97e14c114 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:02.983589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1111/2216] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:03.251588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd6a21-049b-4556-a95a-fb841a2b2169 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:03.253263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-75dd6a21-049b-4556-a95a-fb841a2b2169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:03.272383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd6a21-049b-4556-a95a-fb841a2b2169 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:03.294090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:03.294090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:03.294090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:03.294090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] PATH_INFO: `/v3/projects/3b72859b9265443ebad20862babc8966` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:03.295891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b72859b9265443ebad20862babc8966)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:03.297813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:03.348914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b72859b9265443ebad20862babc8966', 'request_id': 'req-6a071262-aa32-41b0-a2e8-45b9b3f098c1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.355536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b72859b9265443ebad20862babc8966', 'request_id': 'req-6a071262-aa32-41b0-a2e8-45b9b3f098c1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.361331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b72859b9265443ebad20862babc8966', 'request_id': 'req-6a071262-aa32-41b0-a2e8-45b9b3f098c1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.373555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] The token cache is being invalidate because project 3b72859b9265443ebad20862babc8966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:03.373836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.374462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.375954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1106/2217] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:03 2022] DELETE /identity/v3/projects/3b72859b9265443ebad20862babc8966 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:03.380087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643a07b-25cd-419f-ae89-50b97e14c114 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:03.390933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643a07b-25cd-419f-ae89-50b97e14c114 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:03.453849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:03.454484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:03.454800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:03.455079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] PATH_INFO: `/v3/users/a37c9104697b4fcabab09ed222f08293` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:03.456929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37c9104697b4fcabab09ed222f08293)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:03.459020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:03.509028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37c9104697b4fcabab09ed222f08293'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.521942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37c9104697b4fcabab09ed222f08293'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.529366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37c9104697b4fcabab09ed222f08293'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.538038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37c9104697b4fcabab09ed222f08293'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.538738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8ace342b-f628-4f8a-a645-fb065b8bbd0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37c9104697b4fcabab09ed222f08293'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.545198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1112/2218] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:03 2022] DELETE /identity/v3/users/a37c9104697b4fcabab09ed222f08293 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:03.850661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:03.852656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:03.867479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a071262-aa32-41b0-a2e8-45b9b3f098c1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:03.930697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:03.931370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:03.931651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:03.931925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] PATH_INFO: `/v3/projects/654c4e0c784f4882bb4d7bb7227c8f00` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:03.933068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654c4e0c784f4882bb4d7bb7227c8f00)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:03.935034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:03.959817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:03.984680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654c4e0c784f4882bb4d7bb7227c8f00', 'request_id': 'req-41502de7-5af0-42ce-9d49-d8b000b2a463'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.991044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654c4e0c784f4882bb4d7bb7227c8f00', 'request_id': 'req-41502de7-5af0-42ce-9d49-d8b000b2a463'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:03.996461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654c4e0c784f4882bb4d7bb7227c8f00', 'request_id': 'req-41502de7-5af0-42ce-9d49-d8b000b2a463'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:04.009219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] The token cache is being invalidate because project 654c4e0c784f4882bb4d7bb7227c8f00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:04.009509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:04.010140 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-41502de7-5af0-42ce-9d49-d8b000b2a463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:04.011725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1107/2219] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:03 2022] DELETE /identity/v3/projects/654c4e0c784f4882bb4d7bb7227c8f00 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:04.016630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd0aff-6fa3-4d74-990d-f36901c1318f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.017100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd0aff-6fa3-4d74-990d-f36901c1318f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.017210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd0aff-6fa3-4d74-990d-f36901c1318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.038381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-17dd0aff-6fa3-4d74-990d-f36901c1318f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:04.039608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-17dd0aff-6fa3-4d74-990d-f36901c1318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:04.057730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:04.101459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1113/2220] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:04.109147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d283c3-2590-45e9-9b5a-65781540b9ee None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.109430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d283c3-2590-45e9-9b5a-65781540b9ee None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.109701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d283c3-2590-45e9-9b5a-65781540b9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.129712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-46d283c3-2590-45e9-9b5a-65781540b9ee None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:04.130934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-46d283c3-2590-45e9-9b5a-65781540b9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:04.138619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1108/2221] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:04.142822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd0aff-6fa3-4d74-990d-f36901c1318f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.153259 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd0aff-6fa3-4d74-990d-f36901c1318f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.158012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57026-f8d4-4867-82ea-e9327d51828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.158552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57026-f8d4-4867-82ea-e9327d51828e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.158864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57026-f8d4-4867-82ea-e9327d51828e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.159171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57026-f8d4-4867-82ea-e9327d51828e admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.159814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b57026-f8d4-4867-82ea-e9327d51828e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:36:04.160875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b57026-f8d4-4867-82ea-e9327d51828e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.162613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b57026-f8d4-4867-82ea-e9327d51828e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.174093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1114/2222] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:36:04.178279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d283c3-2590-45e9-9b5a-65781540b9ee None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.187490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d283c3-2590-45e9-9b5a-65781540b9ee None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.192138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39936eb-a17f-4bb9-8f76-5e96fb2b2ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.192719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39936eb-a17f-4bb9-8f76-5e96fb2b2ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.192995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39936eb-a17f-4bb9-8f76-5e96fb2b2ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.193261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39936eb-a17f-4bb9-8f76-5e96fb2b2ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.193877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39936eb-a17f-4bb9-8f76-5e96fb2b2ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.195795 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39936eb-a17f-4bb9-8f76-5e96fb2b2ad3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.223507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1109/2223] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:04 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:04.227472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57026-f8d4-4867-82ea-e9327d51828e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.237548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57026-f8d4-4867-82ea-e9327d51828e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.291950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464c356-f96b-478e-85a7-8eb899f597fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.292393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464c356-f96b-478e-85a7-8eb899f597fe admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.292670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464c356-f96b-478e-85a7-8eb899f597fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.292939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464c356-f96b-478e-85a7-8eb899f597fe admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.293565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464c356-f96b-478e-85a7-8eb899f597fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.295503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464c356-f96b-478e-85a7-8eb899f597fe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.317969 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1115/2224] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:04 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:36:04.322163 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39936eb-a17f-4bb9-8f76-5e96fb2b2ad3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.332871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39936eb-a17f-4bb9-8f76-5e96fb2b2ad3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.337661 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a180c-5eca-4060-9d1d-01cf101695d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.338256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a180c-5eca-4060-9d1d-01cf101695d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.338540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a180c-5eca-4060-9d1d-01cf101695d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.338848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a180c-5eca-4060-9d1d-01cf101695d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.339490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a180c-5eca-4060-9d1d-01cf101695d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.341064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a180c-5eca-4060-9d1d-01cf101695d2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.351507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1110/2225] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:04.355363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464c356-f96b-478e-85a7-8eb899f597fe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.365909 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464c356-f96b-478e-85a7-8eb899f597fe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.370507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811a68d-e3a3-43ae-94d0-82752df774eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.371266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811a68d-e3a3-43ae-94d0-82752df774eb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.371555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811a68d-e3a3-43ae-94d0-82752df774eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.371830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811a68d-e3a3-43ae-94d0-82752df774eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.372607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811a68d-e3a3-43ae-94d0-82752df774eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.374218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811a68d-e3a3-43ae-94d0-82752df774eb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.385444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1116/2226] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:04.389614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a180c-5eca-4060-9d1d-01cf101695d2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.401202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a180c-5eca-4060-9d1d-01cf101695d2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.406013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261babe-89e3-4236-94b6-85c5807d20b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.406714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261babe-89e3-4236-94b6-85c5807d20b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.407011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261babe-89e3-4236-94b6-85c5807d20b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.407283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261babe-89e3-4236-94b6-85c5807d20b1 admin admin] PATH_INFO: `/v3/projects/282418076f6f44a7b782ae1759ec129f/users/ccd10cca8e194e25b2549aaaa1cd9892/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.422345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261babe-89e3-4236-94b6-85c5807d20b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282418076f6f44a7b782ae1759ec129f, user_id=ccd10cca8e194e25b2549aaaa1cd9892, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.425059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261babe-89e3-4236-94b6-85c5807d20b1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.437972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1111/2227] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:04 2022] PUT /identity/v3/projects/282418076f6f44a7b782ae1759ec129f/users/ccd10cca8e194e25b2549aaaa1cd9892/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:04.449663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc14e6-7114-4786-b940-64af7b4bc9db None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.449950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc14e6-7114-4786-b940-64af7b4bc9db None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.450332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc14e6-7114-4786-b940-64af7b4bc9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.481367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8dfc14e6-7114-4786-b940-64af7b4bc9db None None] MFA Rules not processed for user `ccd10cca8e194e25b2549aaaa1cd9892`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:04.482849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8dfc14e6-7114-4786-b940-64af7b4bc9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:04.556147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1117/2228] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:04.560551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261babe-89e3-4236-94b6-85c5807d20b1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.624339 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261babe-89e3-4236-94b6-85c5807d20b1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.629580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f86a15-3615-4763-92a6-9a29be10f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.630230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86a15-3615-4763-92a6-9a29be10f68c admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.630507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86a15-3615-4763-92a6-9a29be10f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.630862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86a15-3615-4763-92a6-9a29be10f68c admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.631496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f86a15-3615-4763-92a6-9a29be10f68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.633538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f86a15-3615-4763-92a6-9a29be10f68c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.660574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1112/2229] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:04 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:36:04.665032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc14e6-7114-4786-b940-64af7b4bc9db None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.677646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc14e6-7114-4786-b940-64af7b4bc9db None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.699036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:04.741511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f452ec3-6b14-4bf0-908d-45346ad7c4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.742132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f452ec3-6b14-4bf0-908d-45346ad7c4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.742416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f452ec3-6b14-4bf0-908d-45346ad7c4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.742712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f452ec3-6b14-4bf0-908d-45346ad7c4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.743358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f452ec3-6b14-4bf0-908d-45346ad7c4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.745292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f452ec3-6b14-4bf0-908d-45346ad7c4b7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.767900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1118/2230] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:04 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:36:04.771566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f86a15-3615-4763-92a6-9a29be10f68c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.782318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f86a15-3615-4763-92a6-9a29be10f68c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.787210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142932-a2c5-44fa-a798-dec88c7a14ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.787901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142932-a2c5-44fa-a798-dec88c7a14ca admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.788247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142932-a2c5-44fa-a798-dec88c7a14ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.788623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142932-a2c5-44fa-a798-dec88c7a14ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.789358 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4142932-a2c5-44fa-a798-dec88c7a14ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.791003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4142932-a2c5-44fa-a798-dec88c7a14ca admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.802805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1113/2231] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:04.806963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f452ec3-6b14-4bf0-908d-45346ad7c4b7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.818333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f452ec3-6b14-4bf0-908d-45346ad7c4b7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.823559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20b554-bb85-48f6-9aa5-de6b5f8a80e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.824221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20b554-bb85-48f6-9aa5-de6b5f8a80e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.824497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20b554-bb85-48f6-9aa5-de6b5f8a80e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.824771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20b554-bb85-48f6-9aa5-de6b5f8a80e9 admin admin] PATH_INFO: `/v3/projects/63e30cc56ca04e25a007a2f570e9b4d9/users/9f766fae48ac457ca25574d74abb2483/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.840363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20b554-bb85-48f6-9aa5-de6b5f8a80e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e30cc56ca04e25a007a2f570e9b4d9, user_id=9f766fae48ac457ca25574d74abb2483, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.843279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20b554-bb85-48f6-9aa5-de6b5f8a80e9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.856717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1119/2232] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:04 2022] PUT /identity/v3/projects/63e30cc56ca04e25a007a2f570e9b4d9/users/9f766fae48ac457ca25574d74abb2483/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:36:04.861029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142932-a2c5-44fa-a798-dec88c7a14ca admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.873144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142932-a2c5-44fa-a798-dec88c7a14ca admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.893279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:04.940381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18babf7-ac63-426c-a7f1-e307a412235b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.940774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18babf7-ac63-426c-a7f1-e307a412235b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.942351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18babf7-ac63-426c-a7f1-e307a412235b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.944932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7577-10ca-47be-8a97-ae98957587dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.945547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7577-10ca-47be-8a97-ae98957587dc admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.945830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7577-10ca-47be-8a97-ae98957587dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.946162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7577-10ca-47be-8a97-ae98957587dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.946913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef7577-10ca-47be-8a97-ae98957587dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.948611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef7577-10ca-47be-8a97-ae98957587dc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.966433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1114/2233] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:04.968012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7577-10ca-47be-8a97-ae98957587dc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:04.981053 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7577-10ca-47be-8a97-ae98957587dc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:04.986838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e937-b727-412f-8607-f1ced5f86382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:04.987508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e937-b727-412f-8607-f1ced5f86382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:04.987835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e937-b727-412f-8607-f1ced5f86382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:04.988683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e937-b727-412f-8607-f1ced5f86382 admin admin] PATH_INFO: `/v3/projects/63e30cc56ca04e25a007a2f570e9b4d9/users/9f766fae48ac457ca25574d74abb2483/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:04.990572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c18babf7-ac63-426c-a7f1-e307a412235b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:04.991039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92e937-b727-412f-8607-f1ced5f86382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e30cc56ca04e25a007a2f570e9b4d9, user_id=9f766fae48ac457ca25574d74abb2483, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:04.994029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92e937-b727-412f-8607-f1ced5f86382 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:04.995341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c18babf7-ac63-426c-a7f1-e307a412235b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:05.010768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1115/2234] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:04 2022] PUT /identity/v3/projects/63e30cc56ca04e25a007a2f570e9b4d9/users/9f766fae48ac457ca25574d74abb2483/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:05.017079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48025130-4e95-4d80-af85-2044e2baa5cd None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:05.017374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48025130-4e95-4d80-af85-2044e2baa5cd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:05.017699 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48025130-4e95-4d80-af85-2044e2baa5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:05.065296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-48025130-4e95-4d80-af85-2044e2baa5cd None None] MFA Rules not processed for user `9f766fae48ac457ca25574d74abb2483`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:05.067092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-48025130-4e95-4d80-af85-2044e2baa5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:05.102666 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1120/2235] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:36:05.136009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18babf7-ac63-426c-a7f1-e307a412235b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:05.137370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c18babf7-ac63-426c-a7f1-e307a412235b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:05.147567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1116/2236] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:36:05.158932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48025130-4e95-4d80-af85-2044e2baa5cd None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:05.161170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-48025130-4e95-4d80-af85-2044e2baa5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:05.218000 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18babf7-ac63-426c-a7f1-e307a412235b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:05.218235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48025130-4e95-4d80-af85-2044e2baa5cd None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:05.221938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e8d69-3e1b-4df3-bfe4-1dcb8e971775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:05.222635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e8d69-3e1b-4df3-bfe4-1dcb8e971775 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:05.223118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e8d69-3e1b-4df3-bfe4-1dcb8e971775 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:05.223399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e8d69-3e1b-4df3-bfe4-1dcb8e971775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:05.223840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715cacf-84c4-4117-9985-0fdae0ac6014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:05.224452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715cacf-84c4-4117-9985-0fdae0ac6014 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:05.224731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715cacf-84c4-4117-9985-0fdae0ac6014 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:05.225214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715cacf-84c4-4117-9985-0fdae0ac6014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:05.232925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e8d69-3e1b-4df3-bfe4-1dcb8e971775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:05.233799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715cacf-84c4-4117-9985-0fdae0ac6014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:05.234539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e8d69-3e1b-4df3-bfe4-1dcb8e971775 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:05.235711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715cacf-84c4-4117-9985-0fdae0ac6014 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:05.245542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1117/2237] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:36:05.248153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1121/2238] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:36:05.794574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e8d69-3e1b-4df3-bfe4-1dcb8e971775 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:05.805543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e8d69-3e1b-4df3-bfe4-1dcb8e971775 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:05.810018 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:05.810663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:05.810974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:05.811265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] PATH_INFO: `/v3/users/ccd10cca8e194e25b2549aaaa1cd9892` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:05.812371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd10cca8e194e25b2549aaaa1cd9892)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:05.814304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:05.841934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:05.861614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd10cca8e194e25b2549aaaa1cd9892'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:05.869010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd10cca8e194e25b2549aaaa1cd9892'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:05.869631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd10cca8e194e25b2549aaaa1cd9892'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:05.881560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd10cca8e194e25b2549aaaa1cd9892'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:05.888325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd10cca8e194e25b2549aaaa1cd9892'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:05.894144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1118/2239] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:05 2022] DELETE /identity/v3/users/ccd10cca8e194e25b2549aaaa1cd9892 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:05.899074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e64f6-b803-4ee4-b338-b14cbad45d2a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:05.899362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e64f6-b803-4ee4-b338-b14cbad45d2a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:05.899637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e64f6-b803-4ee4-b338-b14cbad45d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:05.918900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-309e64f6-b803-4ee4-b338-b14cbad45d2a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:05.920095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-309e64f6-b803-4ee4-b338-b14cbad45d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:05.925011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:05.978915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1122/2240] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:05.989451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:05.990882 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:06.046836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64eb50-4ee8-4a6c-b798-33a856139398 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:06.051267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1b9c4-c6af-44c8-a150-08fdd08eaeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:06.051997 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1b9c4-c6af-44c8-a150-08fdd08eaeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:06.052481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1b9c4-c6af-44c8-a150-08fdd08eaeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:06.052668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1b9c4-c6af-44c8-a150-08fdd08eaeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:06.063562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1b9c4-c6af-44c8-a150-08fdd08eaeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:06.065133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1b9c4-c6af-44c8-a150-08fdd08eaeb9 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:06.075461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1119/2241] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:06.433108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e64f6-b803-4ee4-b338-b14cbad45d2a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:06.434573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-309e64f6-b803-4ee4-b338-b14cbad45d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:06.458044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e64f6-b803-4ee4-b338-b14cbad45d2a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:06.463792 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:06.464463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:06.464739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:06.465009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] PATH_INFO: `/v3/projects/282418076f6f44a7b782ae1759ec129f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:06.466127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=282418076f6f44a7b782ae1759ec129f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:06.468686 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:06.517322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282418076f6f44a7b782ae1759ec129f', 'request_id': 'req-c3095373-f3a7-47d4-84cf-c9506b9325d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.525576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282418076f6f44a7b782ae1759ec129f', 'request_id': 'req-c3095373-f3a7-47d4-84cf-c9506b9325d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.531368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282418076f6f44a7b782ae1759ec129f', 'request_id': 'req-c3095373-f3a7-47d4-84cf-c9506b9325d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.543010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] The token cache is being invalidate because project 282418076f6f44a7b782ae1759ec129f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:06.543328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.544263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.546075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1123/2242] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:06 2022] DELETE /identity/v3/projects/282418076f6f44a7b782ae1759ec129f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:06.549756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1b9c4-c6af-44c8-a150-08fdd08eaeb9 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:06.560622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1b9c4-c6af-44c8-a150-08fdd08eaeb9 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:06.621885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:06.622507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:06.622815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:06.623184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] PATH_INFO: `/v3/users/9f766fae48ac457ca25574d74abb2483` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:06.624305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f766fae48ac457ca25574d74abb2483)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:06.626215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:06.672004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f766fae48ac457ca25574d74abb2483'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.673672 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:06.679870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f766fae48ac457ca25574d74abb2483'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.680604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f766fae48ac457ca25574d74abb2483'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.693990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f766fae48ac457ca25574d74abb2483'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.700944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b3fc447-3158-42c4-8492-6f2bea11eb49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f766fae48ac457ca25574d74abb2483'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:06.707536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1120/2243] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:06 2022] DELETE /identity/v3/users/9f766fae48ac457ca25574d74abb2483 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:06.975398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:06.976902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:06.990298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3095373-f3a7-47d4-84cf-c9506b9325d3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.050176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.051469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.051936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.052209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] PATH_INFO: `/v3/projects/63e30cc56ca04e25a007a2f570e9b4d9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.053386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e30cc56ca04e25a007a2f570e9b4d9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.055641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.097139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:07.108129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e30cc56ca04e25a007a2f570e9b4d9', 'request_id': 'req-085c86bc-6726-4f8d-b6a4-13dae45fb761'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.115900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e30cc56ca04e25a007a2f570e9b4d9', 'request_id': 'req-085c86bc-6726-4f8d-b6a4-13dae45fb761'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.121410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e30cc56ca04e25a007a2f570e9b4d9', 'request_id': 'req-085c86bc-6726-4f8d-b6a4-13dae45fb761'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.132508 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] The token cache is being invalidate because project 63e30cc56ca04e25a007a2f570e9b4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:07.132776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.133396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-085c86bc-6726-4f8d-b6a4-13dae45fb761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.134912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1124/2244] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:06 2022] DELETE /identity/v3/projects/63e30cc56ca04e25a007a2f570e9b4d9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:07.139835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313192-1da5-4413-ba3b-082cdf81669a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.140295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313192-1da5-4413-ba3b-082cdf81669a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.140403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313192-1da5-4413-ba3b-082cdf81669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.160896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-50313192-1da5-4413-ba3b-082cdf81669a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:07.162082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-50313192-1da5-4413-ba3b-082cdf81669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:07.218740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1121/2245] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:07.228248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510511-fb54-415b-a877-666b2adabb07 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.228535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510511-fb54-415b-a877-666b2adabb07 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.228811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510511-fb54-415b-a877-666b2adabb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.248404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-88510511-fb54-415b-a877-666b2adabb07 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:07.249581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-88510511-fb54-415b-a877-666b2adabb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:07.258495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1125/2246] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:07.262660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313192-1da5-4413-ba3b-082cdf81669a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.273102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313192-1da5-4413-ba3b-082cdf81669a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.277668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2a5c4-0e32-4826-93bb-95d8be660b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.278259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a5c4-0e32-4826-93bb-95d8be660b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.278535 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a5c4-0e32-4826-93bb-95d8be660b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.278848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a5c4-0e32-4826-93bb-95d8be660b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.279514 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2a5c4-0e32-4826-93bb-95d8be660b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:36:07.279814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2a5c4-0e32-4826-93bb-95d8be660b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.281403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2a5c4-0e32-4826-93bb-95d8be660b17 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.292679 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1122/2247] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:36:07.296884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510511-fb54-415b-a877-666b2adabb07 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.306155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510511-fb54-415b-a877-666b2adabb07 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.311038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5674d-b5ef-4ef9-b267-7e27975c02cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.311646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5674d-b5ef-4ef9-b267-7e27975c02cc admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.311931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5674d-b5ef-4ef9-b267-7e27975c02cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.312241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5674d-b5ef-4ef9-b267-7e27975c02cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.312879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5674d-b5ef-4ef9-b267-7e27975c02cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.314847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5674d-b5ef-4ef9-b267-7e27975c02cc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.342375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1126/2248] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:07 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:07.346317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2a5c4-0e32-4826-93bb-95d8be660b17 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.357534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2a5c4-0e32-4826-93bb-95d8be660b17 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.425649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50c8fb-28a8-4e97-9300-5d80c5672af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.426405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c8fb-28a8-4e97-9300-5d80c5672af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.426870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c8fb-28a8-4e97-9300-5d80c5672af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.427384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c8fb-28a8-4e97-9300-5d80c5672af3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.428200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50c8fb-28a8-4e97-9300-5d80c5672af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.430360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50c8fb-28a8-4e97-9300-5d80c5672af3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.460793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1123/2249] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:07 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:36:07.464616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5674d-b5ef-4ef9-b267-7e27975c02cc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.476525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5674d-b5ef-4ef9-b267-7e27975c02cc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.482327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9883ef-0d33-42a7-ac92-2f74856f4912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.482800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9883ef-0d33-42a7-ac92-2f74856f4912 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.483004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9883ef-0d33-42a7-ac92-2f74856f4912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.483268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9883ef-0d33-42a7-ac92-2f74856f4912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.483923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9883ef-0d33-42a7-ac92-2f74856f4912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.485809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9883ef-0d33-42a7-ac92-2f74856f4912 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.497984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1127/2250] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:07.501894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50c8fb-28a8-4e97-9300-5d80c5672af3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.514716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50c8fb-28a8-4e97-9300-5d80c5672af3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.520425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eb29a-3b8c-486e-8230-1f25ef0234c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.521164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eb29a-3b8c-486e-8230-1f25ef0234c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.521499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eb29a-3b8c-486e-8230-1f25ef0234c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.521776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eb29a-3b8c-486e-8230-1f25ef0234c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.522424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eb29a-3b8c-486e-8230-1f25ef0234c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.524197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eb29a-3b8c-486e-8230-1f25ef0234c3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.539086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1124/2251] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:07.540091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9883ef-0d33-42a7-ac92-2f74856f4912 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.551128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9883ef-0d33-42a7-ac92-2f74856f4912 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.556341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e161a-e894-43d2-a6cd-b35b4d33b916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.556939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e161a-e894-43d2-a6cd-b35b4d33b916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.557217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e161a-e894-43d2-a6cd-b35b4d33b916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.557493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e161a-e894-43d2-a6cd-b35b4d33b916 admin admin] PATH_INFO: `/v3/projects/d05977685a9f4d1b8b403fe6ed0c44b4/users/c28daa878778485199be9e4b5da9566e/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.573975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e161a-e894-43d2-a6cd-b35b4d33b916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05977685a9f4d1b8b403fe6ed0c44b4, user_id=c28daa878778485199be9e4b5da9566e, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.576712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e161a-e894-43d2-a6cd-b35b4d33b916 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.589477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1128/2252] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:07 2022] PUT /identity/v3/projects/d05977685a9f4d1b8b403fe6ed0c44b4/users/c28daa878778485199be9e4b5da9566e/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:07.601380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfc310-63f9-49d4-99e3-ff7bf7a8aba7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.601677 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfc310-63f9-49d4-99e3-ff7bf7a8aba7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.601993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfc310-63f9-49d4-99e3-ff7bf7a8aba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.634567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-24dfc310-63f9-49d4-99e3-ff7bf7a8aba7 None None] MFA Rules not processed for user `c28daa878778485199be9e4b5da9566e`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:07.635891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-24dfc310-63f9-49d4-99e3-ff7bf7a8aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:07.662537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:07.739353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1125/2253] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:07.744015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e161a-e894-43d2-a6cd-b35b4d33b916 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.818895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e161a-e894-43d2-a6cd-b35b4d33b916 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.823685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b5614-9340-43d5-8f9c-f06fd0f58f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.824314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b5614-9340-43d5-8f9c-f06fd0f58f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.824653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b5614-9340-43d5-8f9c-f06fd0f58f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.824979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b5614-9340-43d5-8f9c-f06fd0f58f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.825712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b5614-9340-43d5-8f9c-f06fd0f58f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.827912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b5614-9340-43d5-8f9c-f06fd0f58f85 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.870724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1129/2254] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:07 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:07.872559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfc310-63f9-49d4-99e3-ff7bf7a8aba7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.883320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfc310-63f9-49d4-99e3-ff7bf7a8aba7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.940271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588502bc-3b71-43a0-b3ed-76d62e070a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.940876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588502bc-3b71-43a0-b3ed-76d62e070a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.941178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588502bc-3b71-43a0-b3ed-76d62e070a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.942176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588502bc-3b71-43a0-b3ed-76d62e070a70 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.942840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588502bc-3b71-43a0-b3ed-76d62e070a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.944787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588502bc-3b71-43a0-b3ed-76d62e070a70 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.965286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1126/2255] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:07 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:07.969499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b5614-9340-43d5-8f9c-f06fd0f58f85 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.980669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b5614-9340-43d5-8f9c-f06fd0f58f85 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.986088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472caaf-2a9a-49e0-aa70-032432cff843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.986725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472caaf-2a9a-49e0-aa70-032432cff843 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.987012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472caaf-2a9a-49e0-aa70-032432cff843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.987288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472caaf-2a9a-49e0-aa70-032432cff843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.987939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472caaf-2a9a-49e0-aa70-032432cff843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.990236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472caaf-2a9a-49e0-aa70-032432cff843 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.001073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1130/2256] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:08.006054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588502bc-3b71-43a0-b3ed-76d62e070a70 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:08.016580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588502bc-3b71-43a0-b3ed-76d62e070a70 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:08.021819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c020b6-193b-4da6-b79f-e69042c91ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:08.022473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c020b6-193b-4da6-b79f-e69042c91ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.022779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c020b6-193b-4da6-b79f-e69042c91ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.023062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c020b6-193b-4da6-b79f-e69042c91ec8 admin admin] PATH_INFO: `/v3/projects/fa685e65f4f7454fb64081cca9566a0e/users/0ab8a7bfbbed4c10b20d13703e6dbfd2/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.039452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c020b6-193b-4da6-b79f-e69042c91ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa685e65f4f7454fb64081cca9566a0e, user_id=0ab8a7bfbbed4c10b20d13703e6dbfd2, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:08.042121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c020b6-193b-4da6-b79f-e69042c91ec8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.050050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbbfaf-5dd2-4a02-be51-d5fd49ec7467 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.050342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbbfaf-5dd2-4a02-be51-d5fd49ec7467 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.050625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbbfaf-5dd2-4a02-be51-d5fd49ec7467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.055953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1127/2257] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:08 2022] PUT /identity/v3/projects/fa685e65f4f7454fb64081cca9566a0e/users/0ab8a7bfbbed4c10b20d13703e6dbfd2/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:36:08.059834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c020b6-193b-4da6-b79f-e69042c91ec8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:08.074647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e2fbbfaf-5dd2-4a02-be51-d5fd49ec7467 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:08.075797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e2fbbfaf-5dd2-4a02-be51-d5fd49ec7467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:08.107334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:08.123919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c020b6-193b-4da6-b79f-e69042c91ec8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:08.128794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446b56-ff91-4665-a149-05ad05c628cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:08.129506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446b56-ff91-4665-a149-05ad05c628cf admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.129784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446b56-ff91-4665-a149-05ad05c628cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.130056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446b56-ff91-4665-a149-05ad05c628cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.130727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81446b56-ff91-4665-a149-05ad05c628cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:08.132337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81446b56-ff91-4665-a149-05ad05c628cf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.138421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1131/2258] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:08.142335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1128/2259] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:36:08.146755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbbfaf-5dd2-4a02-be51-d5fd49ec7467 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:08.153381 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446b56-ff91-4665-a149-05ad05c628cf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:08.155091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-81446b56-ff91-4665-a149-05ad05c628cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:08.156184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbbfaf-5dd2-4a02-be51-d5fd49ec7467 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:08.161654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab25510-4e2a-407a-8e25-9088ab83681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:08.162309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab25510-4e2a-407a-8e25-9088ab83681a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.162588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab25510-4e2a-407a-8e25-9088ab83681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.162892 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab25510-4e2a-407a-8e25-9088ab83681a admin admin] PATH_INFO: `/v3/projects/fa685e65f4f7454fb64081cca9566a0e/users/0ab8a7bfbbed4c10b20d13703e6dbfd2/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.164802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab25510-4e2a-407a-8e25-9088ab83681a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa685e65f4f7454fb64081cca9566a0e, user_id=0ab8a7bfbbed4c10b20d13703e6dbfd2, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:08.167607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab25510-4e2a-407a-8e25-9088ab83681a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.178749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1132/2260] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:08 2022] PUT /identity/v3/projects/fa685e65f4f7454fb64081cca9566a0e/users/0ab8a7bfbbed4c10b20d13703e6dbfd2/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:36:08.182050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:08.189769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc10e73-5211-4b0e-9337-fab78529a845 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.190053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc10e73-5211-4b0e-9337-fab78529a845 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.190351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc10e73-5211-4b0e-9337-fab78529a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.217625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1cc10e73-5211-4b0e-9337-fab78529a845 None None] MFA Rules not processed for user `0ab8a7bfbbed4c10b20d13703e6dbfd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:08.218894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1cc10e73-5211-4b0e-9337-fab78529a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:08.229567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446b56-ff91-4665-a149-05ad05c628cf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:08.289600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1133/2261] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:08.295208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb11ef-358b-4779-b469-fe106e82c670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:08.295929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb11ef-358b-4779-b469-fe106e82c670 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.296089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb11ef-358b-4779-b469-fe106e82c670 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.296361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb11ef-358b-4779-b469-fe106e82c670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.301824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc10e73-5211-4b0e-9337-fab78529a845 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:08.303217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1cc10e73-5211-4b0e-9337-fab78529a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:08.356650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb11ef-358b-4779-b469-fe106e82c670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:08.358282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb11ef-358b-4779-b469-fe106e82c670 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.362088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc10e73-5211-4b0e-9337-fab78529a845 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:08.366007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bfc93-3063-4599-aa3b-51e795e670d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:08.366637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bfc93-3063-4599-aa3b-51e795e670d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.366944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bfc93-3063-4599-aa3b-51e795e670d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.367214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bfc93-3063-4599-aa3b-51e795e670d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.368453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1129/2262] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:36:08.376429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bfc93-3063-4599-aa3b-51e795e670d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:08.377863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bfc93-3063-4599-aa3b-51e795e670d7 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.388061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1134/2263] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:36:08.461816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb11ef-358b-4779-b469-fe106e82c670 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:08.471194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb11ef-358b-4779-b469-fe106e82c670 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:08.475053 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5999f-2ae5-4683-8a0b-76515c6facb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:08.475651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5999f-2ae5-4683-8a0b-76515c6facb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.475932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5999f-2ae5-4683-8a0b-76515c6facb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.477190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5999f-2ae5-4683-8a0b-76515c6facb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.526330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:08.536172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5999f-2ae5-4683-8a0b-76515c6facb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:08.537593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5999f-2ae5-4683-8a0b-76515c6facb6 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.546659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1130/2264] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:08.822380 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bfc93-3063-4599-aa3b-51e795e670d7 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:08.835903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bfc93-3063-4599-aa3b-51e795e670d7 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:08.841499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:08.842202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.842557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.843010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] PATH_INFO: `/v3/users/c28daa878778485199be9e4b5da9566e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.844250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28daa878778485199be9e4b5da9566e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:08.846298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.910547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:08.912898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28daa878778485199be9e4b5da9566e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.928599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28daa878778485199be9e4b5da9566e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.936085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28daa878778485199be9e4b5da9566e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.944742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28daa878778485199be9e4b5da9566e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.946949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28daa878778485199be9e4b5da9566e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.955039 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1135/2265] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:08 2022] DELETE /identity/v3/users/c28daa878778485199be9e4b5da9566e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:08.960060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314c156-fb07-449c-a1b4-950ec13d10f5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.960346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314c156-fb07-449c-a1b4-950ec13d10f5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.960624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314c156-fb07-449c-a1b4-950ec13d10f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.981269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5314c156-fb07-449c-a1b4-950ec13d10f5 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:08.982497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5314c156-fb07-449c-a1b4-950ec13d10f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:09.049099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1131/2266] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:09.060065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:09.061495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:09.129438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adfd3b-a33d-4075-a854-5a078b312d06 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:09.132993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581efc95-5720-4021-9583-d3f58705d546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:09.133599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581efc95-5720-4021-9583-d3f58705d546 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:09.133880 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581efc95-5720-4021-9583-d3f58705d546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:09.134154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581efc95-5720-4021-9583-d3f58705d546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:09.142999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581efc95-5720-4021-9583-d3f58705d546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:09.145131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581efc95-5720-4021-9583-d3f58705d546 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:09.154720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1136/2267] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:36:09.418471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314c156-fb07-449c-a1b4-950ec13d10f5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:09.426740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5314c156-fb07-449c-a1b4-950ec13d10f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:09.440361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314c156-fb07-449c-a1b4-950ec13d10f5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:09.445960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:09.446799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:09.447712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:09.447712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] PATH_INFO: `/v3/projects/d05977685a9f4d1b8b403fe6ed0c44b4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:09.448959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05977685a9f4d1b8b403fe6ed0c44b4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:09.451388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:09.501927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05977685a9f4d1b8b403fe6ed0c44b4', 'request_id': 'req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.509022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05977685a9f4d1b8b403fe6ed0c44b4', 'request_id': 'req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.514461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05977685a9f4d1b8b403fe6ed0c44b4', 'request_id': 'req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.526344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] The token cache is being invalidate because project d05977685a9f4d1b8b403fe6ed0c44b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:09.526626 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.527273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.528741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1132/2268] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:09 2022] DELETE /identity/v3/projects/d05977685a9f4d1b8b403fe6ed0c44b4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:09.533239 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581efc95-5720-4021-9583-d3f58705d546 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:09.542942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581efc95-5720-4021-9583-d3f58705d546 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:09.598730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:09.599352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:09.599628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:09.599903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] PATH_INFO: `/v3/users/0ab8a7bfbbed4c10b20d13703e6dbfd2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:09.601011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab8a7bfbbed4c10b20d13703e6dbfd2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:09.602955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:09.647425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab8a7bfbbed4c10b20d13703e6dbfd2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.658791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab8a7bfbbed4c10b20d13703e6dbfd2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.660924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:09.667215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab8a7bfbbed4c10b20d13703e6dbfd2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.675217 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab8a7bfbbed4c10b20d13703e6dbfd2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.675955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7289cf2c-694b-4ac7-88a3-2d19d815c737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab8a7bfbbed4c10b20d13703e6dbfd2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.681995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1137/2269] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:09 2022] DELETE /identity/v3/users/0ab8a7bfbbed4c10b20d13703e6dbfd2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:09.996461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:09.997980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:10.025477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa49dd-833f-4bb5-bf17-51fd3cbf1719 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.096377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.097041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.097321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.098176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] PATH_INFO: `/v3/projects/fa685e65f4f7454fb64081cca9566a0e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.099363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa685e65f4f7454fb64081cca9566a0e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.101316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.118573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:10.150932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa685e65f4f7454fb64081cca9566a0e', 'request_id': 'req-badcd27f-c7a1-4a20-abfa-dbb8014b5112'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.157734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa685e65f4f7454fb64081cca9566a0e', 'request_id': 'req-badcd27f-c7a1-4a20-abfa-dbb8014b5112'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.164862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa685e65f4f7454fb64081cca9566a0e', 'request_id': 'req-badcd27f-c7a1-4a20-abfa-dbb8014b5112'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.178222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] The token cache is being invalidate because project fa685e65f4f7454fb64081cca9566a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:10.178512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.179340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-badcd27f-c7a1-4a20-abfa-dbb8014b5112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.180886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1133/2270] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:09 2022] DELETE /identity/v3/projects/fa685e65f4f7454fb64081cca9566a0e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:10.185790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6fe9-d911-414c-b290-f0aab67c7ed8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.186303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6fe9-d911-414c-b290-f0aab67c7ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.186423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6fe9-d911-414c-b290-f0aab67c7ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.207423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-77de6fe9-d911-414c-b290-f0aab67c7ed8 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:10.208626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-77de6fe9-d911-414c-b290-f0aab67c7ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:10.286959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1138/2271] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:10.288905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75dd14-79a1-4745-8350-e21d2e9d8f2e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.289344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75dd14-79a1-4745-8350-e21d2e9d8f2e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.289690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75dd14-79a1-4745-8350-e21d2e9d8f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.320926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5f75dd14-79a1-4745-8350-e21d2e9d8f2e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:10.322148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5f75dd14-79a1-4745-8350-e21d2e9d8f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:10.334343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1134/2272] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:10.335605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de6fe9-d911-414c-b290-f0aab67c7ed8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.346176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de6fe9-d911-414c-b290-f0aab67c7ed8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.353043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581358a6-dd5a-4bb4-bfcd-229b58552059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.353661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581358a6-dd5a-4bb4-bfcd-229b58552059 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.353940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581358a6-dd5a-4bb4-bfcd-229b58552059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.354210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581358a6-dd5a-4bb4-bfcd-229b58552059 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.354893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581358a6-dd5a-4bb4-bfcd-229b58552059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:36:10.355194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581358a6-dd5a-4bb4-bfcd-229b58552059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.356814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581358a6-dd5a-4bb4-bfcd-229b58552059 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.371501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1139/2273] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:36:10.375689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75dd14-79a1-4745-8350-e21d2e9d8f2e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.385459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75dd14-79a1-4745-8350-e21d2e9d8f2e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.390094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7e1f-91ef-4515-95d1-bd3fa915a6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.390735 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7e1f-91ef-4515-95d1-bd3fa915a6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.390994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7e1f-91ef-4515-95d1-bd3fa915a6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.391265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7e1f-91ef-4515-95d1-bd3fa915a6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.391903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab7e1f-91ef-4515-95d1-bd3fa915a6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.393865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab7e1f-91ef-4515-95d1-bd3fa915a6e7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.421005 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1135/2274] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:36:10.425138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581358a6-dd5a-4bb4-bfcd-229b58552059 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.435800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581358a6-dd5a-4bb4-bfcd-229b58552059 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.491846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62d436-d54d-4f34-a143-d894b4785653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.492452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62d436-d54d-4f34-a143-d894b4785653 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.492736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62d436-d54d-4f34-a143-d894b4785653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.493015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62d436-d54d-4f34-a143-d894b4785653 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.493657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62d436-d54d-4f34-a143-d894b4785653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.495657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62d436-d54d-4f34-a143-d894b4785653 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.517109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1140/2275] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:10.522128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7e1f-91ef-4515-95d1-bd3fa915a6e7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.533487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7e1f-91ef-4515-95d1-bd3fa915a6e7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.538407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f558a-00a9-4cc3-ac71-dc1204641916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.539037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f558a-00a9-4cc3-ac71-dc1204641916 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.539317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f558a-00a9-4cc3-ac71-dc1204641916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.539590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f558a-00a9-4cc3-ac71-dc1204641916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.540236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f558a-00a9-4cc3-ac71-dc1204641916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.541887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f558a-00a9-4cc3-ac71-dc1204641916 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.552473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1136/2276] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:10.556649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62d436-d54d-4f34-a143-d894b4785653 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.567502 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62d436-d54d-4f34-a143-d894b4785653 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.573010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbde4f-0786-4a02-b93e-e2dcdc16fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.573808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbde4f-0786-4a02-b93e-e2dcdc16fda4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.574123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbde4f-0786-4a02-b93e-e2dcdc16fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.574417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbde4f-0786-4a02-b93e-e2dcdc16fda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.575181 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbde4f-0786-4a02-b93e-e2dcdc16fda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.577011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbde4f-0786-4a02-b93e-e2dcdc16fda4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.591017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1141/2277] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:10.595272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f558a-00a9-4cc3-ac71-dc1204641916 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.606006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f558a-00a9-4cc3-ac71-dc1204641916 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.611234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923deca-a065-48e1-958b-569861f69547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.611875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923deca-a065-48e1-958b-569861f69547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.612150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923deca-a065-48e1-958b-569861f69547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.612421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923deca-a065-48e1-958b-569861f69547 admin admin] PATH_INFO: `/v3/projects/7593c5704a994eac85594fe0fd68ebfb/users/e06954cb663e428aaa5c75fef66c0f93/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.627516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923deca-a065-48e1-958b-569861f69547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7593c5704a994eac85594fe0fd68ebfb, user_id=e06954cb663e428aaa5c75fef66c0f93, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.630658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923deca-a065-48e1-958b-569861f69547 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.643431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1137/2278] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:10 2022] PUT /identity/v3/projects/7593c5704a994eac85594fe0fd68ebfb/users/e06954cb663e428aaa5c75fef66c0f93/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:10.649009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b6216-f5f6-4de0-a93d-0ae4a305aa02 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.649291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b6216-f5f6-4de0-a93d-0ae4a305aa02 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.649557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b6216-f5f6-4de0-a93d-0ae4a305aa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.668590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ba6b6216-f5f6-4de0-a93d-0ae4a305aa02 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:10.669795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ba6b6216-f5f6-4de0-a93d-0ae4a305aa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:10.715915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:10.732113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1142/2279] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:10.742399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923deca-a065-48e1-958b-569861f69547 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.744089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5923deca-a065-48e1-958b-569861f69547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:10.800562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923deca-a065-48e1-958b-569861f69547 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.804610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4fa1-7f28-457b-8c16-a254c867d6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.805208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4fa1-7f28-457b-8c16-a254c867d6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.805489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4fa1-7f28-457b-8c16-a254c867d6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.805756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4fa1-7f28-457b-8c16-a254c867d6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.815092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4fa1-7f28-457b-8c16-a254c867d6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.816556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4fa1-7f28-457b-8c16-a254c867d6c6 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.826080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1138/2280] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:11.305330 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435f4b0-b610-4031-8f2c-f35305c20c40 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:11.305900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435f4b0-b610-4031-8f2c-f35305c20c40 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:11.306106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435f4b0-b610-4031-8f2c-f35305c20c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:11.326483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0435f4b0-b610-4031-8f2c-f35305c20c40 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:11.327758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0435f4b0-b610-4031-8f2c-f35305c20c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:11.337804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1143/2281] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:11.356494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4fa1-7f28-457b-8c16-a254c867d6c6 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:11.359031 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8dea4fa1-7f28-457b-8c16-a254c867d6c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:11.420294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:11.466491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4fa1-7f28-457b-8c16-a254c867d6c6 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:11.475759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de84a8e-870b-41f6-922c-545f11105ac3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:11.476974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de84a8e-870b-41f6-922c-545f11105ac3 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:11.477254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de84a8e-870b-41f6-922c-545f11105ac3 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:11.477528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de84a8e-870b-41f6-922c-545f11105ac3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:11.489459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de84a8e-870b-41f6-922c-545f11105ac3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:11.491701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de84a8e-870b-41f6-922c-545f11105ac3 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:11.514447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1139/2282] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:11.540010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2f3ab-e6a3-4737-8919-f8b8b3ed82b6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:11.540482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2f3ab-e6a3-4737-8919-f8b8b3ed82b6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:11.540813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2f3ab-e6a3-4737-8919-f8b8b3ed82b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:11.572160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3ea2f3ab-e6a3-4737-8919-f8b8b3ed82b6 None None] MFA Rules not processed for user `e06954cb663e428aaa5c75fef66c0f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:11.573379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ea2f3ab-e6a3-4737-8919-f8b8b3ed82b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:11.680948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1144/2283] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:11.693512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de84a8e-870b-41f6-922c-545f11105ac3 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:11.695828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0de84a8e-870b-41f6-922c-545f11105ac3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:11.761143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de84a8e-870b-41f6-922c-545f11105ac3 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:11.765197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218246c9-72eb-4f5c-a2c3-ffbe7b762435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:11.765821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218246c9-72eb-4f5c-a2c3-ffbe7b762435 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:11.766104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218246c9-72eb-4f5c-a2c3-ffbe7b762435 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:11.766374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218246c9-72eb-4f5c-a2c3-ffbe7b762435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:11.776047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218246c9-72eb-4f5c-a2c3-ffbe7b762435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:11.777385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218246c9-72eb-4f5c-a2c3-ffbe7b762435 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:11.788135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1140/2284] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:13.167369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7404d2-96b3-4bcb-90d9-39b267dc5a31 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:13.167869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7404d2-96b3-4bcb-90d9-39b267dc5a31 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:13.167869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7404d2-96b3-4bcb-90d9-39b267dc5a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:13.187078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6f7404d2-96b3-4bcb-90d9-39b267dc5a31 None None] MFA Rules not processed for user `e06954cb663e428aaa5c75fef66c0f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:13.188377 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6f7404d2-96b3-4bcb-90d9-39b267dc5a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:13.196237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1145/2285] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:14.461226 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf39faa-e708-429a-90ff-a8a890bd0526 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:14.462091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf39faa-e708-429a-90ff-a8a890bd0526 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:14.462897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf39faa-e708-429a-90ff-a8a890bd0526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:14.504699 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ebf39faa-e708-429a-90ff-a8a890bd0526 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:14.506425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ebf39faa-e708-429a-90ff-a8a890bd0526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:14.516104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1141/2286] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:14.539363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7404d2-96b3-4bcb-90d9-39b267dc5a31 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:14.558322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7404d2-96b3-4bcb-90d9-39b267dc5a31 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:14.566026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea863271-92e5-4b38-b0b1-38ec03cca0fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:14.579803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863271-92e5-4b38-b0b1-38ec03cca0fc service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:14.580089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863271-92e5-4b38-b0b1-38ec03cca0fc service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:14.581517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863271-92e5-4b38-b0b1-38ec03cca0fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:14.595726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea863271-92e5-4b38-b0b1-38ec03cca0fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:14.597714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea863271-92e5-4b38-b0b1-38ec03cca0fc service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:14.621483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1146/2287] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:18.585132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d0627-559e-47c1-b278-10379a8a11b5 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:18.586023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d0627-559e-47c1-b278-10379a8a11b5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:18.586664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d0627-559e-47c1-b278-10379a8a11b5 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:18.589260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1142/2288] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:36:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:36:18.728250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0aeec-ac36-4393-b05a-69468c1be437 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:18.728823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0aeec-ac36-4393-b05a-69468c1be437 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:18.729311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0aeec-ac36-4393-b05a-69468c1be437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:18.752193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-18a0aeec-ac36-4393-b05a-69468c1be437 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:18.753563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18a0aeec-ac36-4393-b05a-69468c1be437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:18.763446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1147/2289] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:18.786815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d0627-559e-47c1-b278-10379a8a11b5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:18.803980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d0627-559e-47c1-b278-10379a8a11b5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:18.812511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ff5b2-1996-4ade-b831-af1d9020d9e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:18.813200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ff5b2-1996-4ade-b831-af1d9020d9e8 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:18.813746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ff5b2-1996-4ade-b831-af1d9020d9e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:18.814090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ff5b2-1996-4ade-b831-af1d9020d9e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:18.821017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f874-be90-4dcb-817a-13b98b459115 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:18.821313 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f874-be90-4dcb-817a-13b98b459115 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:18.821597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f874-be90-4dcb-817a-13b98b459115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:18.823926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ff5b2-1996-4ade-b831-af1d9020d9e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:18.825743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ff5b2-1996-4ade-b831-af1d9020d9e8 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:18.837998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1143/2290] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:18.859826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3003f874-be90-4dcb-817a-13b98b459115 None None] MFA Rules not processed for user `cc99489aa0e14928871b6f7b2c955068`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:18.861353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3003f874-be90-4dcb-817a-13b98b459115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:18.920013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ff5b2-1996-4ade-b831-af1d9020d9e8 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:18.922031 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b65ff5b2-1996-4ade-b831-af1d9020d9e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:18.943137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ff5b2-1996-4ade-b831-af1d9020d9e8 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:18.947553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1148/2291] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:36:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:36:18.948714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:18.949401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:18.949733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:18.949951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] PATH_INFO: `/v3/users/351875cfbfc44edc92145ac4e3f96b1a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:18.951139 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=351875cfbfc44edc92145ac4e3f96b1a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:18.953185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:18.963802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003f874-be90-4dcb-817a-13b98b459115 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:18.967743 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3003f874-be90-4dcb-817a-13b98b459115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:18.991500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003f874-be90-4dcb-817a-13b98b459115 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:18.997937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85652a51-bff8-4f90-b67a-56e77169acfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:18.998637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652a51-bff8-4f90-b67a-56e77169acfb service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:18.999154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652a51-bff8-4f90-b67a-56e77169acfb service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:18.999496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652a51-bff8-4f90-b67a-56e77169acfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:19.009580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85652a51-bff8-4f90-b67a-56e77169acfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:19.011087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351875cfbfc44edc92145ac4e3f96b1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.011399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85652a51-bff8-4f90-b67a-56e77169acfb service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:19.019794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351875cfbfc44edc92145ac4e3f96b1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.020499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351875cfbfc44edc92145ac4e3f96b1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.022911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1149/2292] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:19.033212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351875cfbfc44edc92145ac4e3f96b1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.044840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351875cfbfc44edc92145ac4e3f96b1a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.051290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1144/2293] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:18 2022] DELETE /identity/v3/users/351875cfbfc44edc92145ac4e3f96b1a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:36:19.230220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85652a51-bff8-4f90-b67a-56e77169acfb service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:19.242563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85652a51-bff8-4f90-b67a-56e77169acfb service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:19.280852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:19.309761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:19.310393 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:19.310672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:19.311095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] PATH_INFO: `/v3/projects/2f2edd9106724cda9d5958ed7cd2ffe5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:19.312225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2edd9106724cda9d5958ed7cd2ffe5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:19.314154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:19.376972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2edd9106724cda9d5958ed7cd2ffe5', 'request_id': 'req-d1e2841d-a339-4615-ad34-b275aeb2618d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.388803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2edd9106724cda9d5958ed7cd2ffe5', 'request_id': 'req-d1e2841d-a339-4615-ad34-b275aeb2618d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.396683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2edd9106724cda9d5958ed7cd2ffe5', 'request_id': 'req-d1e2841d-a339-4615-ad34-b275aeb2618d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.414495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] The token cache is being invalidate because project 2f2edd9106724cda9d5958ed7cd2ffe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:19.414890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.416956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.419591 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1150/2294] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:19 2022] DELETE /identity/v3/projects/2f2edd9106724cda9d5958ed7cd2ffe5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:19.423770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:19.425515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:19.448089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a7ae-b402-4a8f-bc34-9dd18aa59084 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:19.476146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:19.539563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:19.540632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:19.541188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:19.541557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] PATH_INFO: `/v3/users/e02116493a26428eae89102496e4913e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:19.543522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02116493a26428eae89102496e4913e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:19.546902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:19.609091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02116493a26428eae89102496e4913e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.618052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02116493a26428eae89102496e4913e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.619473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02116493a26428eae89102496e4913e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.634158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02116493a26428eae89102496e4913e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.641174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ce86404-6444-4300-a53b-c84e20d1330f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02116493a26428eae89102496e4913e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.648197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1145/2295] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:19 2022] DELETE /identity/v3/users/e02116493a26428eae89102496e4913e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:19.823743 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:19.825564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:19.842313 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2841d-a339-4615-ad34-b275aeb2618d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:19.910935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:19.911560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:19.911858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:19.912126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] PATH_INFO: `/v3/projects/b3cff150770543f0abbbf97fa3cba488` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:19.913323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cff150770543f0abbbf97fa3cba488)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:19.915813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:19.964683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cff150770543f0abbbf97fa3cba488', 'request_id': 'req-892ba4f7-731a-42c1-99ae-e11cc3b669d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.972724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cff150770543f0abbbf97fa3cba488', 'request_id': 'req-892ba4f7-731a-42c1-99ae-e11cc3b669d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.978590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:19.979917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cff150770543f0abbbf97fa3cba488', 'request_id': 'req-892ba4f7-731a-42c1-99ae-e11cc3b669d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.995810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] The token cache is being invalidate because project b3cff150770543f0abbbf97fa3cba488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:19.996278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.997030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-892ba4f7-731a-42c1-99ae-e11cc3b669d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:19.998512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1151/2296] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:19 2022] DELETE /identity/v3/projects/b3cff150770543f0abbbf97fa3cba488 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:20.004195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0c91e-1b5b-4068-a847-05837c8751bf None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.007572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0c91e-1b5b-4068-a847-05837c8751bf None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.007925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0c91e-1b5b-4068-a847-05837c8751bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.028566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-16a0c91e-1b5b-4068-a847-05837c8751bf None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:20.030185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-16a0c91e-1b5b-4068-a847-05837c8751bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:20.100696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1146/2297] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:20.108973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1a779-c5ab-463e-a7d8-52c1c3b1ed71 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.109257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1a779-c5ab-463e-a7d8-52c1c3b1ed71 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.109559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1a779-c5ab-463e-a7d8-52c1c3b1ed71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.130803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-13c1a779-c5ab-463e-a7d8-52c1c3b1ed71 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:20.131825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-13c1a779-c5ab-463e-a7d8-52c1c3b1ed71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:20.139772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1152/2298] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:20.143890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0c91e-1b5b-4068-a847-05837c8751bf None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.153504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0c91e-1b5b-4068-a847-05837c8751bf None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.158026 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372977a6-1b01-4291-8ead-73a1ea09df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.158616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372977a6-1b01-4291-8ead-73a1ea09df7f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.158922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372977a6-1b01-4291-8ead-73a1ea09df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.159192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372977a6-1b01-4291-8ead-73a1ea09df7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.160462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372977a6-1b01-4291-8ead-73a1ea09df7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:36:20.160760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372977a6-1b01-4291-8ead-73a1ea09df7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.162410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372977a6-1b01-4291-8ead-73a1ea09df7f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.173652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1147/2299] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:36:20.178290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1a779-c5ab-463e-a7d8-52c1c3b1ed71 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.187565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1a779-c5ab-463e-a7d8-52c1c3b1ed71 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.192270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90c488-34e8-438d-a219-dd0a45d305c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.192857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90c488-34e8-438d-a219-dd0a45d305c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.193137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90c488-34e8-438d-a219-dd0a45d305c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.193412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90c488-34e8-438d-a219-dd0a45d305c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.194035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90c488-34e8-438d-a219-dd0a45d305c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.196004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90c488-34e8-438d-a219-dd0a45d305c5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.224097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1153/2300] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:20 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:20.228156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372977a6-1b01-4291-8ead-73a1ea09df7f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.242875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372977a6-1b01-4291-8ead-73a1ea09df7f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.271415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:20.301073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021baf-0f94-4871-9d02-997ade4b3b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.301770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021baf-0f94-4871-9d02-997ade4b3b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.302051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021baf-0f94-4871-9d02-997ade4b3b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.302325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021baf-0f94-4871-9d02-997ade4b3b12 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.303001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021baf-0f94-4871-9d02-997ade4b3b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.304925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021baf-0f94-4871-9d02-997ade4b3b12 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.325794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1148/2301] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:20 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:36:20.329884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90c488-34e8-438d-a219-dd0a45d305c5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.340080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90c488-34e8-438d-a219-dd0a45d305c5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.344685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce6dbd-5e29-44d7-8c4e-4694f14d4eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.345279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce6dbd-5e29-44d7-8c4e-4694f14d4eec admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.345559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce6dbd-5e29-44d7-8c4e-4694f14d4eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.345830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce6dbd-5e29-44d7-8c4e-4694f14d4eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.346471 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce6dbd-5e29-44d7-8c4e-4694f14d4eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.348857 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce6dbd-5e29-44d7-8c4e-4694f14d4eec admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.358570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1154/2302] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:20.362652 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021baf-0f94-4871-9d02-997ade4b3b12 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.373306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021baf-0f94-4871-9d02-997ade4b3b12 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.377923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072dc5d-8731-4288-9cb0-2b0bb8bc9d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.378512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072dc5d-8731-4288-9cb0-2b0bb8bc9d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.379092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072dc5d-8731-4288-9cb0-2b0bb8bc9d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.379092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072dc5d-8731-4288-9cb0-2b0bb8bc9d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.379707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072dc5d-8731-4288-9cb0-2b0bb8bc9d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.381298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072dc5d-8731-4288-9cb0-2b0bb8bc9d03 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.391814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1149/2303] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:20.396400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce6dbd-5e29-44d7-8c4e-4694f14d4eec admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.406227 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce6dbd-5e29-44d7-8c4e-4694f14d4eec admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.411605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ef466-c6ec-4ff4-af6d-8c3229899ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.412248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ef466-c6ec-4ff4-af6d-8c3229899ade admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.412582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ef466-c6ec-4ff4-af6d-8c3229899ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.412806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ef466-c6ec-4ff4-af6d-8c3229899ade admin admin] PATH_INFO: `/v3/projects/07e1f66ed7de4e2d943641e6e83ca71b/users/930c35b7d09c41eb869fd5c4a4576171/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.427104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ef466-c6ec-4ff4-af6d-8c3229899ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e1f66ed7de4e2d943641e6e83ca71b, user_id=930c35b7d09c41eb869fd5c4a4576171, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.429755 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ef466-c6ec-4ff4-af6d-8c3229899ade admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.442130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1155/2304] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:20 2022] PUT /identity/v3/projects/07e1f66ed7de4e2d943641e6e83ca71b/users/930c35b7d09c41eb869fd5c4a4576171/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:20.452047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5719ae-0e29-4d7f-b3a3-bb6b3cebdc00 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.452334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5719ae-0e29-4d7f-b3a3-bb6b3cebdc00 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.452608 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5719ae-0e29-4d7f-b3a3-bb6b3cebdc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.480991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cb5719ae-0e29-4d7f-b3a3-bb6b3cebdc00 None None] MFA Rules not processed for user `930c35b7d09c41eb869fd5c4a4576171`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:20.482214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cb5719ae-0e29-4d7f-b3a3-bb6b3cebdc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:20.546042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1150/2305] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:20.551030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ef466-c6ec-4ff4-af6d-8c3229899ade admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.617447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ef466-c6ec-4ff4-af6d-8c3229899ade admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.622441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40177dc8-8da4-451a-a724-593892c049d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.623214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177dc8-8da4-451a-a724-593892c049d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.623495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177dc8-8da4-451a-a724-593892c049d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.623771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177dc8-8da4-451a-a724-593892c049d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.624408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40177dc8-8da4-451a-a724-593892c049d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.626333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40177dc8-8da4-451a-a724-593892c049d4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.662364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1156/2306] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:20 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:20.663679 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5719ae-0e29-4d7f-b3a3-bb6b3cebdc00 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.677634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5719ae-0e29-4d7f-b3a3-bb6b3cebdc00 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.779000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534653-77d5-461d-9c59-050d8e4de6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.779387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534653-77d5-461d-9c59-050d8e4de6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.779769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534653-77d5-461d-9c59-050d8e4de6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.780014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534653-77d5-461d-9c59-050d8e4de6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.780600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86534653-77d5-461d-9c59-050d8e4de6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.783471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86534653-77d5-461d-9c59-050d8e4de6a3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.810622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1151/2307] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:20 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:36:20.814597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40177dc8-8da4-451a-a724-593892c049d4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.825530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40177dc8-8da4-451a-a724-593892c049d4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.830281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c1a0-3064-4b07-96d0-f28923ed340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.830919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c1a0-3064-4b07-96d0-f28923ed340d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.831203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c1a0-3064-4b07-96d0-f28923ed340d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.831480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c1a0-3064-4b07-96d0-f28923ed340d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.832706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88c1a0-3064-4b07-96d0-f28923ed340d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.834317 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88c1a0-3064-4b07-96d0-f28923ed340d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.848075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1157/2308] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:20.852087 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534653-77d5-461d-9c59-050d8e4de6a3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.862175 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534653-77d5-461d-9c59-050d8e4de6a3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.866841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c705ae5-d66c-4a9a-a05d-4e28b6b2dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.867493 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c705ae5-d66c-4a9a-a05d-4e28b6b2dda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.867769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c705ae5-d66c-4a9a-a05d-4e28b6b2dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.868041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c705ae5-d66c-4a9a-a05d-4e28b6b2dda0 admin admin] PATH_INFO: `/v3/projects/711dbb0e052f4328b26a53b2cb5ae2f6/users/0e3b88e1beb7431c823506a9b059b337/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.883786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c705ae5-d66c-4a9a-a05d-4e28b6b2dda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711dbb0e052f4328b26a53b2cb5ae2f6, user_id=0e3b88e1beb7431c823506a9b059b337, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.886497 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c705ae5-d66c-4a9a-a05d-4e28b6b2dda0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.903231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1152/2309] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:20 2022] PUT /identity/v3/projects/711dbb0e052f4328b26a53b2cb5ae2f6/users/0e3b88e1beb7431c823506a9b059b337/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:36:20.906974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c1a0-3064-4b07-96d0-f28923ed340d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:20.921102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c1a0-3064-4b07-96d0-f28923ed340d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:20.981776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737e8e8-1f2e-4850-87d2-6016ad4b80a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:20.982390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737e8e8-1f2e-4850-87d2-6016ad4b80a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:20.982672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737e8e8-1f2e-4850-87d2-6016ad4b80a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:20.982977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737e8e8-1f2e-4850-87d2-6016ad4b80a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:20.983655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737e8e8-1f2e-4850-87d2-6016ad4b80a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:20.985522 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737e8e8-1f2e-4850-87d2-6016ad4b80a3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:20.987873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:20.999912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1158/2310] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:21.004891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c705ae5-d66c-4a9a-a05d-4e28b6b2dda0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:21.011518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:21.015850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c705ae5-d66c-4a9a-a05d-4e28b6b2dda0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:21.022785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac65b4-6dbf-46bd-bd91-5f33b15e5421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:21.023592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac65b4-6dbf-46bd-bd91-5f33b15e5421 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:21.023874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac65b4-6dbf-46bd-bd91-5f33b15e5421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:21.024167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac65b4-6dbf-46bd-bd91-5f33b15e5421 admin admin] PATH_INFO: `/v3/projects/711dbb0e052f4328b26a53b2cb5ae2f6/users/0e3b88e1beb7431c823506a9b059b337/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:21.026411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac65b4-6dbf-46bd-bd91-5f33b15e5421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711dbb0e052f4328b26a53b2cb5ae2f6, user_id=0e3b88e1beb7431c823506a9b059b337, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:21.029200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac65b4-6dbf-46bd-bd91-5f33b15e5421 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:21.040398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1153/2311] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:21 2022] PUT /identity/v3/projects/711dbb0e052f4328b26a53b2cb5ae2f6/users/0e3b88e1beb7431c823506a9b059b337/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:21.051862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e3fbf-91ce-415e-9abe-8d34020578e1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:21.052151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e3fbf-91ce-415e-9abe-8d34020578e1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:21.052421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e3fbf-91ce-415e-9abe-8d34020578e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:21.082860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-598e3fbf-91ce-415e-9abe-8d34020578e1 None None] MFA Rules not processed for user `0e3b88e1beb7431c823506a9b059b337`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:21.084303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-598e3fbf-91ce-415e-9abe-8d34020578e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:21.166584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1159/2312] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:21.178498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac65b4-6dbf-46bd-bd91-5f33b15e5421 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:21.180315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-40ac65b4-6dbf-46bd-bd91-5f33b15e5421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:21.259297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac65b4-6dbf-46bd-bd91-5f33b15e5421 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:21.264566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68332-808e-4e69-b195-4735cec5e103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:21.265266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68332-808e-4e69-b195-4735cec5e103 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:21.265612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68332-808e-4e69-b195-4735cec5e103 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:21.266124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68332-808e-4e69-b195-4735cec5e103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:21.362712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d68332-808e-4e69-b195-4735cec5e103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:21.364224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d68332-808e-4e69-b195-4735cec5e103 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:21.373654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1154/2313] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:22.931607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f30f-3660-4c31-a5f2-1af8ddb20114 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:22.932164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f30f-3660-4c31-a5f2-1af8ddb20114 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:22.932256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f30f-3660-4c31-a5f2-1af8ddb20114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:22.952815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9191f30f-3660-4c31-a5f2-1af8ddb20114 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:22.954028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9191f30f-3660-4c31-a5f2-1af8ddb20114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:23.025848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1160/2314] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:23.043790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68332-808e-4e69-b195-4735cec5e103 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:23.045673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c2d68332-808e-4e69-b195-4735cec5e103 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:23.139635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68332-808e-4e69-b195-4735cec5e103 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:23.145183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3075a-7571-4a69-9d62-e222864b0e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:23.145833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3075a-7571-4a69-9d62-e222864b0e56 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:23.146109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3075a-7571-4a69-9d62-e222864b0e56 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:23.146564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3075a-7571-4a69-9d62-e222864b0e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:23.157904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3075a-7571-4a69-9d62-e222864b0e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:23.159420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3075a-7571-4a69-9d62-e222864b0e56 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:23.175248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1155/2315] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:36:23.920500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191f30f-3660-4c31-a5f2-1af8ddb20114 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:23.930482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191f30f-3660-4c31-a5f2-1af8ddb20114 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:23.935075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:23.935705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:23.935984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:23.936256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] PATH_INFO: `/v3/users/930c35b7d09c41eb869fd5c4a4576171` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:23.937420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] RBAC: Authorizing `identity:delete_user(user_id=930c35b7d09c41eb869fd5c4a4576171)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:23.939386 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:23.987062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930c35b7d09c41eb869fd5c4a4576171'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:23.998595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930c35b7d09c41eb869fd5c4a4576171'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.005867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930c35b7d09c41eb869fd5c4a4576171'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.009332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:24.013604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930c35b7d09c41eb869fd5c4a4576171'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.014616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930c35b7d09c41eb869fd5c4a4576171'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.022480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1161/2316] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:23 2022] DELETE /identity/v3/users/930c35b7d09c41eb869fd5c4a4576171 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:36:24.026880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60199-fb45-4689-8057-fe553008a80f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:24.027171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60199-fb45-4689-8057-fe553008a80f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:24.027449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60199-fb45-4689-8057-fe553008a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:24.046387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3ab60199-fb45-4689-8057-fe553008a80f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:24.047615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3ab60199-fb45-4689-8057-fe553008a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:24.073416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:24.109117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1156/2317] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:24.119752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:24.121234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:24.178350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8bd36-8d89-4ae6-9533-11796f48443a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:24.181963 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a734e-83f1-43b4-8038-1b1c36d6a83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:24.182568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a734e-83f1-43b4-8038-1b1c36d6a83b service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:24.182887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a734e-83f1-43b4-8038-1b1c36d6a83b service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:24.183163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a734e-83f1-43b4-8038-1b1c36d6a83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:24.192088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a734e-83f1-43b4-8038-1b1c36d6a83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:24.194096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a734e-83f1-43b4-8038-1b1c36d6a83b service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:24.203620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1162/2318] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:36:24.576191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab60199-fb45-4689-8057-fe553008a80f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:24.578560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3ab60199-fb45-4689-8057-fe553008a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:24.591905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab60199-fb45-4689-8057-fe553008a80f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:24.596996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:24.597864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:24.598225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:24.599218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] PATH_INFO: `/v3/projects/07e1f66ed7de4e2d943641e6e83ca71b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:24.600430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e1f66ed7de4e2d943641e6e83ca71b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:24.603181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:24.652337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e1f66ed7de4e2d943641e6e83ca71b', 'request_id': 'req-d85c5282-bc23-491c-9a21-0d6849515af8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.658517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e1f66ed7de4e2d943641e6e83ca71b', 'request_id': 'req-d85c5282-bc23-491c-9a21-0d6849515af8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.664725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e1f66ed7de4e2d943641e6e83ca71b', 'request_id': 'req-d85c5282-bc23-491c-9a21-0d6849515af8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.677818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] The token cache is being invalidate because project 07e1f66ed7de4e2d943641e6e83ca71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:24.678119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.678775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.680306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1157/2319] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:24 2022] DELETE /identity/v3/projects/07e1f66ed7de4e2d943641e6e83ca71b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:24.684285 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a734e-83f1-43b4-8038-1b1c36d6a83b service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:24.693891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a734e-83f1-43b4-8038-1b1c36d6a83b service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:24.749278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:24.749897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:24.750176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:24.750447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] PATH_INFO: `/v3/users/0e3b88e1beb7431c823506a9b059b337` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:24.751586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3b88e1beb7431c823506a9b059b337)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:24.753510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:24.796957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3b88e1beb7431c823506a9b059b337'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.809374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3b88e1beb7431c823506a9b059b337'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.816510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3b88e1beb7431c823506a9b059b337'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.825174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3b88e1beb7431c823506a9b059b337'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.825691 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-524580ee-b35e-481e-84d3-2a14003cab5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3b88e1beb7431c823506a9b059b337'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:24.832112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1163/2320] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:24 2022] DELETE /identity/v3/users/0e3b88e1beb7431c823506a9b059b337 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:25.243042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:25.244684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:25.260104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c5282-bc23-491c-9a21-0d6849515af8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:25.319675 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:25.320307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.320579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.320848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] PATH_INFO: `/v3/projects/711dbb0e052f4328b26a53b2cb5ae2f6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:25.322021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711dbb0e052f4328b26a53b2cb5ae2f6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:25.324008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:25.380995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711dbb0e052f4328b26a53b2cb5ae2f6', 'request_id': 'req-378b2025-506a-4e09-b180-175ad3ba94f5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:25.389949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711dbb0e052f4328b26a53b2cb5ae2f6', 'request_id': 'req-378b2025-506a-4e09-b180-175ad3ba94f5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:25.396383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:25.397763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711dbb0e052f4328b26a53b2cb5ae2f6', 'request_id': 'req-378b2025-506a-4e09-b180-175ad3ba94f5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:25.413746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] The token cache is being invalidate because project 711dbb0e052f4328b26a53b2cb5ae2f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:25.414227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:25.415279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-378b2025-506a-4e09-b180-175ad3ba94f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:25.417678 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1158/2321] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:25 2022] DELETE /identity/v3/projects/711dbb0e052f4328b26a53b2cb5ae2f6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:25.422531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedf83b-97a0-4603-ad4c-93991fba0881 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.423462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedf83b-97a0-4603-ad4c-93991fba0881 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.423831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedf83b-97a0-4603-ad4c-93991fba0881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:25.449692 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-daedf83b-97a0-4603-ad4c-93991fba0881 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:25.450999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-daedf83b-97a0-4603-ad4c-93991fba0881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:25.475698 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:25.549153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1164/2322] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:25.554869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1b2dc-ed23-47eb-b627-da56c454f193 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.555152 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1b2dc-ed23-47eb-b627-da56c454f193 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.555479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1b2dc-ed23-47eb-b627-da56c454f193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:25.577262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6eb1b2dc-ed23-47eb-b627-da56c454f193 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:25.579367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6eb1b2dc-ed23-47eb-b627-da56c454f193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:25.591788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1159/2323] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:36:25.592966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedf83b-97a0-4603-ad4c-93991fba0881 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:25.604327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedf83b-97a0-4603-ad4c-93991fba0881 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:25.609842 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be016def-fe39-40c9-9771-c43133721894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:25.610753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016def-fe39-40c9-9771-c43133721894 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.611079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016def-fe39-40c9-9771-c43133721894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.611358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016def-fe39-40c9-9771-c43133721894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:25.612037 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be016def-fe39-40c9-9771-c43133721894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:36:25.612343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be016def-fe39-40c9-9771-c43133721894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:25.614658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be016def-fe39-40c9-9771-c43133721894 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:25.628342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1165/2324] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:36:25.633028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1b2dc-ed23-47eb-b627-da56c454f193 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:25.642627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1b2dc-ed23-47eb-b627-da56c454f193 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:25.649515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfb2f9-4839-4fac-a619-e11c17b08ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:25.649515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfb2f9-4839-4fac-a619-e11c17b08ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.649869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfb2f9-4839-4fac-a619-e11c17b08ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.650077 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfb2f9-4839-4fac-a619-e11c17b08ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:25.650674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfb2f9-4839-4fac-a619-e11c17b08ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:25.652609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfb2f9-4839-4fac-a619-e11c17b08ba6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:25.706728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1160/2325] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:25 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:25.710999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be016def-fe39-40c9-9771-c43133721894 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:25.721231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be016def-fe39-40c9-9771-c43133721894 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:25.791018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332293bb-0cf6-4c6b-8462-aa7b2421db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:25.791903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332293bb-0cf6-4c6b-8462-aa7b2421db19 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.792184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332293bb-0cf6-4c6b-8462-aa7b2421db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.792664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332293bb-0cf6-4c6b-8462-aa7b2421db19 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:25.793098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332293bb-0cf6-4c6b-8462-aa7b2421db19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:25.795232 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332293bb-0cf6-4c6b-8462-aa7b2421db19 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:25.839999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1166/2326] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:25 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:25.844079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfb2f9-4839-4fac-a619-e11c17b08ba6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:25.855336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfb2f9-4839-4fac-a619-e11c17b08ba6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:25.859934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04688-a293-4c6a-a864-be9b6a467ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:25.860782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04688-a293-4c6a-a864-be9b6a467ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.861058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04688-a293-4c6a-a864-be9b6a467ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.861331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04688-a293-4c6a-a864-be9b6a467ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:25.861972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee04688-a293-4c6a-a864-be9b6a467ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:25.863614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee04688-a293-4c6a-a864-be9b6a467ad9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:25.873447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1161/2327] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:36:25.877301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332293bb-0cf6-4c6b-8462-aa7b2421db19 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:25.887487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332293bb-0cf6-4c6b-8462-aa7b2421db19 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:25.892171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087ce58-2053-4ea3-87c7-3e3a3e748ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:25.892908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087ce58-2053-4ea3-87c7-3e3a3e748ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.893055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087ce58-2053-4ea3-87c7-3e3a3e748ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.893323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087ce58-2053-4ea3-87c7-3e3a3e748ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:25.893972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087ce58-2053-4ea3-87c7-3e3a3e748ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:25.896175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087ce58-2053-4ea3-87c7-3e3a3e748ad8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:25.907602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1167/2328] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:25.912329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04688-a293-4c6a-a864-be9b6a467ad9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:25.922196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04688-a293-4c6a-a864-be9b6a467ad9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:25.926861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be034ef3-3ad5-4ae9-b9cd-3ebc5c9bdd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:25.927501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be034ef3-3ad5-4ae9-b9cd-3ebc5c9bdd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.927777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be034ef3-3ad5-4ae9-b9cd-3ebc5c9bdd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.928044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be034ef3-3ad5-4ae9-b9cd-3ebc5c9bdd59 admin admin] PATH_INFO: `/v3/projects/079650898ddc4d66a82e5c79006096ba/users/9bfd86de147941aa90d6eee03fa75406/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:25.942508 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be034ef3-3ad5-4ae9-b9cd-3ebc5c9bdd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=079650898ddc4d66a82e5c79006096ba, user_id=9bfd86de147941aa90d6eee03fa75406, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:25.946360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be034ef3-3ad5-4ae9-b9cd-3ebc5c9bdd59 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:25.959851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1162/2329] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:25 2022] PUT /identity/v3/projects/079650898ddc4d66a82e5c79006096ba/users/9bfd86de147941aa90d6eee03fa75406/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:36:25.969973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217db29-cc1a-47d5-9225-4130d1a00ffd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:25.970261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217db29-cc1a-47d5-9225-4130d1a00ffd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:25.970554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217db29-cc1a-47d5-9225-4130d1a00ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.002188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d217db29-cc1a-47d5-9225-4130d1a00ffd None None] MFA Rules not processed for user `9bfd86de147941aa90d6eee03fa75406`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:26.003363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d217db29-cc1a-47d5-9225-4130d1a00ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:26.070024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1168/2330] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:36:26.074598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be034ef3-3ad5-4ae9-b9cd-3ebc5c9bdd59 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.184625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be034ef3-3ad5-4ae9-b9cd-3ebc5c9bdd59 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.189544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe56241-7b97-4a49-a5de-d2e85450171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.190224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe56241-7b97-4a49-a5de-d2e85450171b admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.190573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe56241-7b97-4a49-a5de-d2e85450171b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.190938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe56241-7b97-4a49-a5de-d2e85450171b admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.191642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe56241-7b97-4a49-a5de-d2e85450171b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.194303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe56241-7b97-4a49-a5de-d2e85450171b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:26.224784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1163/2331] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:26 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:36:26.230990 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217db29-cc1a-47d5-9225-4130d1a00ffd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.246181 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217db29-cc1a-47d5-9225-4130d1a00ffd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.257474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:26.315319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20303d1a-c8bc-4478-a38b-fe9ee319b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.315945 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20303d1a-c8bc-4478-a38b-fe9ee319b90e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.316215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20303d1a-c8bc-4478-a38b-fe9ee319b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.316486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20303d1a-c8bc-4478-a38b-fe9ee319b90e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.317232 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20303d1a-c8bc-4478-a38b-fe9ee319b90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.319248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20303d1a-c8bc-4478-a38b-fe9ee319b90e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:26.341104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1169/2332] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:26 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:26.345197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe56241-7b97-4a49-a5de-d2e85450171b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.356035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe56241-7b97-4a49-a5de-d2e85450171b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.361097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c592e6-161a-4251-ba07-048e6cf1d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.361690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c592e6-161a-4251-ba07-048e6cf1d32c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.361963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c592e6-161a-4251-ba07-048e6cf1d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.362227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c592e6-161a-4251-ba07-048e6cf1d32c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.362901 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c592e6-161a-4251-ba07-048e6cf1d32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.364592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c592e6-161a-4251-ba07-048e6cf1d32c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:26.375361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1164/2333] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:26.379314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20303d1a-c8bc-4478-a38b-fe9ee319b90e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.389619 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20303d1a-c8bc-4478-a38b-fe9ee319b90e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.394266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7360dc-c144-4130-8deb-706797c358d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.394898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7360dc-c144-4130-8deb-706797c358d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.395734 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7360dc-c144-4130-8deb-706797c358d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.396120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7360dc-c144-4130-8deb-706797c358d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.396772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7360dc-c144-4130-8deb-706797c358d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.398528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7360dc-c144-4130-8deb-706797c358d1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:26.410233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1170/2334] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:36:26.414615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c592e6-161a-4251-ba07-048e6cf1d32c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.425032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c592e6-161a-4251-ba07-048e6cf1d32c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.430442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3068b8-4ed7-4665-85d0-a0e5516f6921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.431176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3068b8-4ed7-4665-85d0-a0e5516f6921 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.431456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3068b8-4ed7-4665-85d0-a0e5516f6921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.431726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3068b8-4ed7-4665-85d0-a0e5516f6921 admin admin] PATH_INFO: `/v3/projects/acb6da8e9a9947578d7b0c9812c8d5b7/users/4fe1a5d387274185aa8594ed5f61c2b2/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.446455 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3068b8-4ed7-4665-85d0-a0e5516f6921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb6da8e9a9947578d7b0c9812c8d5b7, user_id=4fe1a5d387274185aa8594ed5f61c2b2, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.449154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3068b8-4ed7-4665-85d0-a0e5516f6921 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:26.463349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1165/2335] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:26 2022] PUT /identity/v3/projects/acb6da8e9a9947578d7b0c9812c8d5b7/users/4fe1a5d387274185aa8594ed5f61c2b2/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:26.475684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188637-6d66-49e3-86c5-a37952e6994e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.476182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188637-6d66-49e3-86c5-a37952e6994e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.476276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188637-6d66-49e3-86c5-a37952e6994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.505246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b9188637-6d66-49e3-86c5-a37952e6994e None None] MFA Rules not processed for user `4fe1a5d387274185aa8594ed5f61c2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:26.506455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9188637-6d66-49e3-86c5-a37952e6994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:26.569827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1171/2336] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:36:26.574190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3068b8-4ed7-4665-85d0-a0e5516f6921 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.611616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:26.647407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3068b8-4ed7-4665-85d0-a0e5516f6921 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.652193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d68e3-aa0a-4e3f-bc3e-45b37145df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.652793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d68e3-aa0a-4e3f-bc3e-45b37145df5c admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.653068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d68e3-aa0a-4e3f-bc3e-45b37145df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.653333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d68e3-aa0a-4e3f-bc3e-45b37145df5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.653963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d68e3-aa0a-4e3f-bc3e-45b37145df5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.655880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d68e3-aa0a-4e3f-bc3e-45b37145df5c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:26.686237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1166/2337] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:26 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:36:26.687511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9188637-6d66-49e3-86c5-a37952e6994e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.699256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9188637-6d66-49e3-86c5-a37952e6994e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.758640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e350b0-68d0-47a7-927b-37406483b722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.759296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e350b0-68d0-47a7-927b-37406483b722 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.759562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e350b0-68d0-47a7-927b-37406483b722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.759835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e350b0-68d0-47a7-927b-37406483b722 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.760768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e350b0-68d0-47a7-927b-37406483b722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.762427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e350b0-68d0-47a7-927b-37406483b722 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:26.784954 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1172/2338] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:26 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:26.788992 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d68e3-aa0a-4e3f-bc3e-45b37145df5c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.804383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d68e3-aa0a-4e3f-bc3e-45b37145df5c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.810548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08999ef2-0a39-4b9f-83d3-cbc46758f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.811276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999ef2-0a39-4b9f-83d3-cbc46758f9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.811655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999ef2-0a39-4b9f-83d3-cbc46758f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.811993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999ef2-0a39-4b9f-83d3-cbc46758f9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.812733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08999ef2-0a39-4b9f-83d3-cbc46758f9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.814396 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08999ef2-0a39-4b9f-83d3-cbc46758f9e7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:26.828304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1167/2339] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:26.832243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e350b0-68d0-47a7-927b-37406483b722 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.846713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e350b0-68d0-47a7-927b-37406483b722 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.858408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793c7f7-80bf-43fb-9366-3516c64b3b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.859194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793c7f7-80bf-43fb-9366-3516c64b3b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.859472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793c7f7-80bf-43fb-9366-3516c64b3b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.859759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793c7f7-80bf-43fb-9366-3516c64b3b57 admin admin] PATH_INFO: `/v3/projects/7d42f1e1422d4ae2ab467b5322938e28/users/2acacf5efa254d2788e2d4b27e05ca1b/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.871122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:26.881480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793c7f7-80bf-43fb-9366-3516c64b3b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d42f1e1422d4ae2ab467b5322938e28, user_id=2acacf5efa254d2788e2d4b27e05ca1b, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.892054 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793c7f7-80bf-43fb-9366-3516c64b3b57 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:26.912107 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1173/2340] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:26 2022] PUT /identity/v3/projects/7d42f1e1422d4ae2ab467b5322938e28/users/2acacf5efa254d2788e2d4b27e05ca1b/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:26.916236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08999ef2-0a39-4b9f-83d3-cbc46758f9e7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:26.928708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08999ef2-0a39-4b9f-83d3-cbc46758f9e7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:26.993119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d289a-fdba-4215-8f36-7e96d9ff70ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:26.993735 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d289a-fdba-4215-8f36-7e96d9ff70ce admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:26.994009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d289a-fdba-4215-8f36-7e96d9ff70ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:26.994340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d289a-fdba-4215-8f36-7e96d9ff70ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:26.994943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d289a-fdba-4215-8f36-7e96d9ff70ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:26.996530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d289a-fdba-4215-8f36-7e96d9ff70ce admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:27.008889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1168/2341] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:36:27.012828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793c7f7-80bf-43fb-9366-3516c64b3b57 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:27.026846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793c7f7-80bf-43fb-9366-3516c64b3b57 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:27.032371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14460da0-8966-42bd-9e5c-e9855a1b5667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:27.033127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14460da0-8966-42bd-9e5c-e9855a1b5667 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:27.033408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14460da0-8966-42bd-9e5c-e9855a1b5667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:27.033731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14460da0-8966-42bd-9e5c-e9855a1b5667 admin admin] PATH_INFO: `/v3/projects/7d42f1e1422d4ae2ab467b5322938e28/users/2acacf5efa254d2788e2d4b27e05ca1b/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:27.036113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14460da0-8966-42bd-9e5c-e9855a1b5667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d42f1e1422d4ae2ab467b5322938e28, user_id=2acacf5efa254d2788e2d4b27e05ca1b, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:27.039225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14460da0-8966-42bd-9e5c-e9855a1b5667 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:27.059127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1174/2342] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:27 2022] PUT /identity/v3/projects/7d42f1e1422d4ae2ab467b5322938e28/users/2acacf5efa254d2788e2d4b27e05ca1b/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:27.071061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf10e0-45e5-4955-9339-0fcea01022b3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:27.071347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf10e0-45e5-4955-9339-0fcea01022b3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:27.071616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf10e0-45e5-4955-9339-0fcea01022b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:27.103111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-bbcf10e0-45e5-4955-9339-0fcea01022b3 None None] MFA Rules not processed for user `2acacf5efa254d2788e2d4b27e05ca1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:27.104219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bbcf10e0-45e5-4955-9339-0fcea01022b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:27.175392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1169/2343] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:27.188343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14460da0-8966-42bd-9e5c-e9855a1b5667 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:27.190112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14460da0-8966-42bd-9e5c-e9855a1b5667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:27.256715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14460da0-8966-42bd-9e5c-e9855a1b5667 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:27.260488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f015b-844c-4e84-b24d-6f501b89b160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:27.261249 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f015b-844c-4e84-b24d-6f501b89b160 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:27.261656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f015b-844c-4e84-b24d-6f501b89b160 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:27.261935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f015b-844c-4e84-b24d-6f501b89b160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:27.336873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f015b-844c-4e84-b24d-6f501b89b160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:27.338358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f015b-844c-4e84-b24d-6f501b89b160 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:27.349735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1175/2344] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:28.869114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf10e0-45e5-4955-9339-0fcea01022b3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:28.880636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf10e0-45e5-4955-9339-0fcea01022b3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:28.884247 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fc896-f793-476f-90c5-4c33ce5de788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:28.884840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fc896-f793-476f-90c5-4c33ce5de788 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:28.885113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fc896-f793-476f-90c5-4c33ce5de788 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:28.885380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fc896-f793-476f-90c5-4c33ce5de788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:28.913693 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:28.949555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fc896-f793-476f-90c5-4c33ce5de788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:28.951322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fc896-f793-476f-90c5-4c33ce5de788 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:28.962922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1170/2345] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:29.635167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f015b-844c-4e84-b24d-6f501b89b160 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:29.636590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-949f015b-844c-4e84-b24d-6f501b89b160 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:29.647682 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f015b-844c-4e84-b24d-6f501b89b160 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:29.651657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd2c77-d5e1-45ed-8b36-bc22238bdc99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:29.652335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd2c77-d5e1-45ed-8b36-bc22238bdc99 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:29.652650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd2c77-d5e1-45ed-8b36-bc22238bdc99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:29.652924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd2c77-d5e1-45ed-8b36-bc22238bdc99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:29.663564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd2c77-d5e1-45ed-8b36-bc22238bdc99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:29.665014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd2c77-d5e1-45ed-8b36-bc22238bdc99 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:29.678371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1176/2346] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:33.562987 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fc896-f793-476f-90c5-4c33ce5de788 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:33.626674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fc896-f793-476f-90c5-4c33ce5de788 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:33.631148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:33.631759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:33.632033 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:33.632300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] PATH_INFO: `/v3/users/9bfd86de147941aa90d6eee03fa75406` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:33.633397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bfd86de147941aa90d6eee03fa75406)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:33.635343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:33.681095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bfd86de147941aa90d6eee03fa75406'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:33.689557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bfd86de147941aa90d6eee03fa75406'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:33.690231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bfd86de147941aa90d6eee03fa75406'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:33.702452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bfd86de147941aa90d6eee03fa75406'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:33.709224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bfd86de147941aa90d6eee03fa75406'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:33.715148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1171/2347] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:33 2022] DELETE /identity/v3/users/9bfd86de147941aa90d6eee03fa75406 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:33.719567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e1ee-df7b-4a82-bba2-73462369219d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:33.720034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e1ee-df7b-4a82-bba2-73462369219d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:33.720129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e1ee-df7b-4a82-bba2-73462369219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:33.740140 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5f41e1ee-df7b-4a82-bba2-73462369219d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:33.741310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5f41e1ee-df7b-4a82-bba2-73462369219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:33.798893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1177/2348] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:33.809103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:33.810491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:33.857160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:33.871017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f951c9-aa4f-4c85-8b94-25fa5d9d62b4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:33.874557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c95e-583e-4cff-a167-ec4df9078b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:33.875204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c95e-583e-4cff-a167-ec4df9078b8d service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:33.875477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c95e-583e-4cff-a167-ec4df9078b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:33.875745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c95e-583e-4cff-a167-ec4df9078b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:33.884460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503c95e-583e-4cff-a167-ec4df9078b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:33.885867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503c95e-583e-4cff-a167-ec4df9078b8d service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:33.894920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1172/2349] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:34.200024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e1ee-df7b-4a82-bba2-73462369219d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:34.201555 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5f41e1ee-df7b-4a82-bba2-73462369219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:34.221452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e1ee-df7b-4a82-bba2-73462369219d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:34.228250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:34.229074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:34.229360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:34.229745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] PATH_INFO: `/v3/projects/079650898ddc4d66a82e5c79006096ba` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:34.231526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=079650898ddc4d66a82e5c79006096ba)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:34.233064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:34.245337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:34.289058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '079650898ddc4d66a82e5c79006096ba', 'request_id': 'req-89e6c46d-3726-417c-b365-2713fbe94084'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.299049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '079650898ddc4d66a82e5c79006096ba', 'request_id': 'req-89e6c46d-3726-417c-b365-2713fbe94084'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.306767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '079650898ddc4d66a82e5c79006096ba', 'request_id': 'req-89e6c46d-3726-417c-b365-2713fbe94084'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.318556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] The token cache is being invalidate because project 079650898ddc4d66a82e5c79006096ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:34.318908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.319792 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.321548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1178/2350] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:34 2022] DELETE /identity/v3/projects/079650898ddc4d66a82e5c79006096ba => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:34.325374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c95e-583e-4cff-a167-ec4df9078b8d service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:34.335778 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c95e-583e-4cff-a167-ec4df9078b8d service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:34.393808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:34.394583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:34.394907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:34.395203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] PATH_INFO: `/v3/users/4fe1a5d387274185aa8594ed5f61c2b2` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:34.396405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe1a5d387274185aa8594ed5f61c2b2)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:34.398600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:34.452345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe1a5d387274185aa8594ed5f61c2b2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.463935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe1a5d387274185aa8594ed5f61c2b2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.464726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe1a5d387274185aa8594ed5f61c2b2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.478360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe1a5d387274185aa8594ed5f61c2b2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.485254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe1a5d387274185aa8594ed5f61c2b2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.493054 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1173/2351] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:34 2022] DELETE /identity/v3/users/4fe1a5d387274185aa8594ed5f61c2b2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:36:34.762600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:34.764088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:34.777452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6c46d-3726-417c-b365-2713fbe94084 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:34.836356 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:34.836915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:34.837195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:34.837470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] PATH_INFO: `/v3/projects/acb6da8e9a9947578d7b0c9812c8d5b7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:34.838616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb6da8e9a9947578d7b0c9812c8d5b7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:34.840617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:34.886768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb6da8e9a9947578d7b0c9812c8d5b7', 'request_id': 'req-72f5d257-7fac-499b-a82b-43e1c67728c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.895005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb6da8e9a9947578d7b0c9812c8d5b7', 'request_id': 'req-72f5d257-7fac-499b-a82b-43e1c67728c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.900910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb6da8e9a9947578d7b0c9812c8d5b7', 'request_id': 'req-72f5d257-7fac-499b-a82b-43e1c67728c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.912193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] The token cache is being invalidate because project acb6da8e9a9947578d7b0c9812c8d5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:34.912478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.913106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:34.914567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1179/2352] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:34 2022] DELETE /identity/v3/projects/acb6da8e9a9947578d7b0c9812c8d5b7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:34.918563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:34.919966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:34.933130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c9627-8581-4f45-aed3-753370f51ace admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:34.988188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:34.989319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:34.989760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:34.990220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] PATH_INFO: `/v3/users/2acacf5efa254d2788e2d4b27e05ca1b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:34.991350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acacf5efa254d2788e2d4b27e05ca1b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:34.993248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:34.998521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:35.043400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acacf5efa254d2788e2d4b27e05ca1b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.052260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acacf5efa254d2788e2d4b27e05ca1b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.052993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acacf5efa254d2788e2d4b27e05ca1b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.065256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acacf5efa254d2788e2d4b27e05ca1b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.073814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c42d854a-3647-463e-a29e-98fd8d789df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acacf5efa254d2788e2d4b27e05ca1b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.080827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1174/2353] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:34 2022] DELETE /identity/v3/users/2acacf5efa254d2788e2d4b27e05ca1b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:35.819999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:35.821617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:35.835578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5d257-7fac-499b-a82b-43e1c67728c2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:35.866825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:35.905683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:35.906327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:35.906609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:35.906937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] PATH_INFO: `/v3/projects/7d42f1e1422d4ae2ab467b5322938e28` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:35.908073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d42f1e1422d4ae2ab467b5322938e28)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:35.910098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:35.964762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d42f1e1422d4ae2ab467b5322938e28', 'request_id': 'req-93dd48c7-f238-4a07-a57c-8234cccddaf9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.973906 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d42f1e1422d4ae2ab467b5322938e28', 'request_id': 'req-93dd48c7-f238-4a07-a57c-8234cccddaf9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.981361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d42f1e1422d4ae2ab467b5322938e28', 'request_id': 'req-93dd48c7-f238-4a07-a57c-8234cccddaf9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.994659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] The token cache is being invalidate because project 7d42f1e1422d4ae2ab467b5322938e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:35.996376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.997113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93dd48c7-f238-4a07-a57c-8234cccddaf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:35.998674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1180/2354] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:35 2022] DELETE /identity/v3/projects/7d42f1e1422d4ae2ab467b5322938e28 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:36.003608 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dd0fd-8cfc-433c-b3f6-096d947d01ed None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.004094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dd0fd-8cfc-433c-b3f6-096d947d01ed None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.004302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dd0fd-8cfc-433c-b3f6-096d947d01ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.024126 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-152dd0fd-8cfc-433c-b3f6-096d947d01ed None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:36.025323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-152dd0fd-8cfc-433c-b3f6-096d947d01ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:36.083616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1175/2355] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:36.091320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934c72f-b065-4632-a670-224ee054d166 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.091611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934c72f-b065-4632-a670-224ee054d166 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.091885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934c72f-b065-4632-a670-224ee054d166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.112220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f934c72f-b065-4632-a670-224ee054d166 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:36.113438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f934c72f-b065-4632-a670-224ee054d166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:36.121912 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1181/2356] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:36.126104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dd0fd-8cfc-433c-b3f6-096d947d01ed None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:36.135803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dd0fd-8cfc-433c-b3f6-096d947d01ed None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:36.140262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270933c-a2e7-46cc-8d01-eb52609f497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:36.140849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270933c-a2e7-46cc-8d01-eb52609f497b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.141127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270933c-a2e7-46cc-8d01-eb52609f497b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.141399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270933c-a2e7-46cc-8d01-eb52609f497b admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.142036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270933c-a2e7-46cc-8d01-eb52609f497b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:36:36.142335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270933c-a2e7-46cc-8d01-eb52609f497b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:36.143965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270933c-a2e7-46cc-8d01-eb52609f497b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:36.156097 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1176/2357] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:36:36.160314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934c72f-b065-4632-a670-224ee054d166 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:36.170318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934c72f-b065-4632-a670-224ee054d166 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:36.174946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573fdc1-d37a-4182-b8c1-d9d21b85639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:36.175530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573fdc1-d37a-4182-b8c1-d9d21b85639d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.175806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573fdc1-d37a-4182-b8c1-d9d21b85639d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.176077 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573fdc1-d37a-4182-b8c1-d9d21b85639d admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.176924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573fdc1-d37a-4182-b8c1-d9d21b85639d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:36.178810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573fdc1-d37a-4182-b8c1-d9d21b85639d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:36.205647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1182/2358] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:36 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:36.210388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270933c-a2e7-46cc-8d01-eb52609f497b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:36.220559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270933c-a2e7-46cc-8d01-eb52609f497b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:36.275578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e245efc-c257-46f5-a25d-3df023fc7ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:36.276177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e245efc-c257-46f5-a25d-3df023fc7ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.276457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e245efc-c257-46f5-a25d-3df023fc7ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.276731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e245efc-c257-46f5-a25d-3df023fc7ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.277353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e245efc-c257-46f5-a25d-3df023fc7ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:36.279304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e245efc-c257-46f5-a25d-3df023fc7ea5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:36.300950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1177/2359] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:36 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:36.305183 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573fdc1-d37a-4182-b8c1-d9d21b85639d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:36.315799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573fdc1-d37a-4182-b8c1-d9d21b85639d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:36.320528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc306c1-0307-4374-abdc-600c6fadcf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:36.321164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc306c1-0307-4374-abdc-600c6fadcf91 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.321450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc306c1-0307-4374-abdc-600c6fadcf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.321725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc306c1-0307-4374-abdc-600c6fadcf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.322759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc306c1-0307-4374-abdc-600c6fadcf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:36.324565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc306c1-0307-4374-abdc-600c6fadcf91 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:36.335321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1183/2360] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:36.339279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e245efc-c257-46f5-a25d-3df023fc7ea5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:36.344422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:36.350250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e245efc-c257-46f5-a25d-3df023fc7ea5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:36.356201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112b31-e3c3-492d-8bb8-d349f403faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:36.356996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112b31-e3c3-492d-8bb8-d349f403faaa admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.357500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112b31-e3c3-492d-8bb8-d349f403faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.358064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112b31-e3c3-492d-8bb8-d349f403faaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.358822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112b31-e3c3-492d-8bb8-d349f403faaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:36.360513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112b31-e3c3-492d-8bb8-d349f403faaa admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:36.371876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1178/2361] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:36:36.375937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc306c1-0307-4374-abdc-600c6fadcf91 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:36.386733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc306c1-0307-4374-abdc-600c6fadcf91 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:36.391493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfad0d-34f5-47ef-a021-766ad99bd377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:36.392149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfad0d-34f5-47ef-a021-766ad99bd377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.392429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfad0d-34f5-47ef-a021-766ad99bd377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.392705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfad0d-34f5-47ef-a021-766ad99bd377 admin admin] PATH_INFO: `/v3/projects/27404c38a0e749adb8d666ad795167cc/users/ad29e5be459b4446a138d7f11913edc8/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.409250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfad0d-34f5-47ef-a021-766ad99bd377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27404c38a0e749adb8d666ad795167cc, user_id=ad29e5be459b4446a138d7f11913edc8, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:36.412617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfad0d-34f5-47ef-a021-766ad99bd377 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:36.427219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1184/2362] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:36 2022] PUT /identity/v3/projects/27404c38a0e749adb8d666ad795167cc/users/ad29e5be459b4446a138d7f11913edc8/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:36.438235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141db93-ff30-4346-b9fa-673fdd4c4e6c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.438519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141db93-ff30-4346-b9fa-673fdd4c4e6c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.438819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141db93-ff30-4346-b9fa-673fdd4c4e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.466053 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c141db93-ff30-4346-b9fa-673fdd4c4e6c None None] MFA Rules not processed for user `ad29e5be459b4446a138d7f11913edc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:36.467273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c141db93-ff30-4346-b9fa-673fdd4c4e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:36.530457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1179/2363] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:36.542142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfad0d-34f5-47ef-a021-766ad99bd377 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:36.543958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-babfad0d-34f5-47ef-a021-766ad99bd377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:36.603956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:36.629952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfad0d-34f5-47ef-a021-766ad99bd377 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:36.633296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0a63c-3204-4146-a0a9-0f6115d67432 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb50ee2f9ccd4a258f3396074db66e74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:36.633900 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0a63c-3204-4146-a0a9-0f6115d67432 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:36.634178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0a63c-3204-4146-a0a9-0f6115d67432 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:36.634445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0a63c-3204-4146-a0a9-0f6115d67432 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:36.649328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0a63c-3204-4146-a0a9-0f6115d67432 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:36.651373 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0a63c-3204-4146-a0a9-0f6115d67432 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:36.664856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1185/2364] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:44.183288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7a4c9-a953-4763-8b4b-3420b24abcff None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:44.183852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7a4c9-a953-4763-8b4b-3420b24abcff None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:44.183852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7a4c9-a953-4763-8b4b-3420b24abcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:44.203958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-11f7a4c9-a953-4763-8b4b-3420b24abcff None None] MFA Rules not processed for user `e06954cb663e428aaa5c75fef66c0f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:44.205148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-11f7a4c9-a953-4763-8b4b-3420b24abcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:44.272106 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1180/2365] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:46.119747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a653-2529-4fee-b7be-112d085a7417 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:46.120279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a653-2529-4fee-b7be-112d085a7417 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:46.120279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a653-2529-4fee-b7be-112d085a7417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:46.152099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0c28a653-2529-4fee-b7be-112d085a7417 None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:46.154802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c28a653-2529-4fee-b7be-112d085a7417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:46.272350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1186/2366] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:36:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:46.323250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7a4c9-a953-4763-8b4b-3420b24abcff None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:46.324768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-11f7a4c9-a953-4763-8b4b-3420b24abcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:46.414242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7a4c9-a953-4763-8b4b-3420b24abcff None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:46.425173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007939d3-6e53-4f10-8486-6a024f59153f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:46.425805 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007939d3-6e53-4f10-8486-6a024f59153f service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:46.426085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007939d3-6e53-4f10-8486-6a024f59153f service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:46.426453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007939d3-6e53-4f10-8486-6a024f59153f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:46.435905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007939d3-6e53-4f10-8486-6a024f59153f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:46.437534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007939d3-6e53-4f10-8486-6a024f59153f service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:46.440565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1a83-abcc-47e8-ad4f-74cda7db5e51 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:46.441151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1a83-abcc-47e8-ad4f-74cda7db5e51 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:46.442418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1a83-abcc-47e8-ad4f-74cda7db5e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:46.448089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1181/2367] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:36:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:36:46.477262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-067f1a83-abcc-47e8-ad4f-74cda7db5e51 None None] MFA Rules not processed for user `1479ebe2a7a7426d9ee1dafa37fbd0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:46.479725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-067f1a83-abcc-47e8-ad4f-74cda7db5e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:46.606195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1187/2368] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:48.597454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5163d-b00c-4798-8499-3f66f2c88ed3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:48.598978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5163d-b00c-4798-8499-3f66f2c88ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:48.599426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5163d-b00c-4798-8499-3f66f2c88ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:48.620663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-00f5163d-b00c-4798-8499-3f66f2c88ed3 None None] MFA Rules not processed for user `40ca5ae5716a4dae824a35cbdde9edc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:48.622217 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-00f5163d-b00c-4798-8499-3f66f2c88ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:48.638495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:48.698714 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1182/2369] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:36:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:56.598209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=60 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:58.685101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=18 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:04.480072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1a83-abcc-47e8-ad4f-74cda7db5e51 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:04.554646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1a83-abcc-47e8-ad4f-74cda7db5e51 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:04.561473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:04.562375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:04.562785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:04.563159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] PATH_INFO: `/v3/users/ad29e5be459b4446a138d7f11913edc8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:04.564511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad29e5be459b4446a138d7f11913edc8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:04.567761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:04.624119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad29e5be459b4446a138d7f11913edc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:04.639347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad29e5be459b4446a138d7f11913edc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:04.646720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad29e5be459b4446a138d7f11913edc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:04.654883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad29e5be459b4446a138d7f11913edc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:04.655548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad29e5be459b4446a138d7f11913edc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:04.663693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1188/2370] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:04 2022] DELETE /identity/v3/users/ad29e5be459b4446a138d7f11913edc8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:04.668445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f105d2-16b6-4756-8718-1f9416e06fd4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:04.677341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f105d2-16b6-4756-8718-1f9416e06fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:04.677739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f105d2-16b6-4756-8718-1f9416e06fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:04.699514 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-30f105d2-16b6-4756-8718-1f9416e06fd4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:04.700824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-30f105d2-16b6-4756-8718-1f9416e06fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:04.769028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1183/2371] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:04.776004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:04.777489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:04.862035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff0c39-6702-4c7a-9dbe-1c231b2745f0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:04.870032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe1ad3-8731-42fe-8734-48814bdb5ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:04.870660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe1ad3-8731-42fe-8734-48814bdb5ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:04.870982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe1ad3-8731-42fe-8734-48814bdb5ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:04.871264 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe1ad3-8731-42fe-8734-48814bdb5ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:04.883098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe1ad3-8731-42fe-8734-48814bdb5ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:04.884569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe1ad3-8731-42fe-8734-48814bdb5ee5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:04.895494 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1189/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:05.208720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f105d2-16b6-4756-8718-1f9416e06fd4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:05.210180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-30f105d2-16b6-4756-8718-1f9416e06fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:05.223777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f105d2-16b6-4756-8718-1f9416e06fd4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:05.228996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:05.229808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.230090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.230409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] PATH_INFO: `/v3/projects/27404c38a0e749adb8d666ad795167cc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.231572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27404c38a0e749adb8d666ad795167cc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:05.233418 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:05.280548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27404c38a0e749adb8d666ad795167cc', 'request_id': 'req-0c412aba-98d7-4148-9917-6946b56796a2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:05.286604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27404c38a0e749adb8d666ad795167cc', 'request_id': 'req-0c412aba-98d7-4148-9917-6946b56796a2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:05.292027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27404c38a0e749adb8d666ad795167cc', 'request_id': 'req-0c412aba-98d7-4148-9917-6946b56796a2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:05.305447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] The token cache is being invalidate because project 27404c38a0e749adb8d666ad795167cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:05.305728 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:05.306373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c412aba-98d7-4148-9917-6946b56796a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:05.307850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1184/2373] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:05 2022] DELETE /identity/v3/projects/27404c38a0e749adb8d666ad795167cc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:05.312693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b701b7-e29c-43ad-b627-85fd4cdf334e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.312978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b701b7-e29c-43ad-b627-85fd4cdf334e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.313251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b701b7-e29c-43ad-b627-85fd4cdf334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.333979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c2b701b7-e29c-43ad-b627-85fd4cdf334e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:05.335343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c2b701b7-e29c-43ad-b627-85fd4cdf334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:05.354131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:05.401834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1190/2374] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:05.409702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ea879-9b6b-48c5-a27b-14409bb28fb5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.409986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ea879-9b6b-48c5-a27b-14409bb28fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.410796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ea879-9b6b-48c5-a27b-14409bb28fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.433099 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2f1ea879-9b6b-48c5-a27b-14409bb28fb5 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:05.434316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2f1ea879-9b6b-48c5-a27b-14409bb28fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:05.442569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1185/2375] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:05.446790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b701b7-e29c-43ad-b627-85fd4cdf334e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:05.456597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b701b7-e29c-43ad-b627-85fd4cdf334e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:05.461467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270acc-a1e2-4a50-9ede-d6a484446163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:05.462071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270acc-a1e2-4a50-9ede-d6a484446163 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.462348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270acc-a1e2-4a50-9ede-d6a484446163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.462628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270acc-a1e2-4a50-9ede-d6a484446163 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.463297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0270acc-a1e2-4a50-9ede-d6a484446163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:37:05.463680 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0270acc-a1e2-4a50-9ede-d6a484446163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:05.465208 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0270acc-a1e2-4a50-9ede-d6a484446163 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:05.477427 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1191/2376] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:37:05.481812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ea879-9b6b-48c5-a27b-14409bb28fb5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:05.492095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ea879-9b6b-48c5-a27b-14409bb28fb5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:05.497435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295fe36-6eb6-43cf-b97e-48b3e6520a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:05.498037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295fe36-6eb6-43cf-b97e-48b3e6520a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.498314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295fe36-6eb6-43cf-b97e-48b3e6520a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.498582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295fe36-6eb6-43cf-b97e-48b3e6520a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.499409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295fe36-6eb6-43cf-b97e-48b3e6520a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:05.501478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295fe36-6eb6-43cf-b97e-48b3e6520a19 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:05.531302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1186/2377] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:05 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:05.533150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270acc-a1e2-4a50-9ede-d6a484446163 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:05.545284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270acc-a1e2-4a50-9ede-d6a484446163 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:05.606267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e702-2d25-4528-8481-c318b0b71097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:05.606919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e702-2d25-4528-8481-c318b0b71097 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.607205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e702-2d25-4528-8481-c318b0b71097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.607482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e702-2d25-4528-8481-c318b0b71097 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.608130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392e702-2d25-4528-8481-c318b0b71097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:05.610066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392e702-2d25-4528-8481-c318b0b71097 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:05.632749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1192/2378] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:05 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:05.636978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295fe36-6eb6-43cf-b97e-48b3e6520a19 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:05.647425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295fe36-6eb6-43cf-b97e-48b3e6520a19 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:05.652129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfc33-18c9-4438-a194-ac5f09b889bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:05.652738 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfc33-18c9-4438-a194-ac5f09b889bd admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.653015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfc33-18c9-4438-a194-ac5f09b889bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.653284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfc33-18c9-4438-a194-ac5f09b889bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.653927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bfc33-18c9-4438-a194-ac5f09b889bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:05.655556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bfc33-18c9-4438-a194-ac5f09b889bd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:05.674390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1187/2379] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:05.675673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e702-2d25-4528-8481-c318b0b71097 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:05.686445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e702-2d25-4528-8481-c318b0b71097 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:05.695973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5297f-bf5f-4c3f-95a0-6412689a0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:05.696818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5297f-bf5f-4c3f-95a0-6412689a0099 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.697314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5297f-bf5f-4c3f-95a0-6412689a0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.698033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5297f-bf5f-4c3f-95a0-6412689a0099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.698729 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5297f-bf5f-4c3f-95a0-6412689a0099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:05.700358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5297f-bf5f-4c3f-95a0-6412689a0099 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:05.712102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1193/2380] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:05.716373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfc33-18c9-4438-a194-ac5f09b889bd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:05.727779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfc33-18c9-4438-a194-ac5f09b889bd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:05.732561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7803d8b-9274-4580-b517-d827c7a38acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:05.733161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803d8b-9274-4580-b517-d827c7a38acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.733439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803d8b-9274-4580-b517-d827c7a38acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.733716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803d8b-9274-4580-b517-d827c7a38acd admin admin] PATH_INFO: `/v3/projects/356a06eb3892409da95d8730fb77a4d2/users/2c951d7c31ce4628a98282934ce66eee/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.750944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7803d8b-9274-4580-b517-d827c7a38acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=356a06eb3892409da95d8730fb77a4d2, user_id=2c951d7c31ce4628a98282934ce66eee, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:05.753793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7803d8b-9274-4580-b517-d827c7a38acd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:05.766701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1188/2381] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:05 2022] PUT /identity/v3/projects/356a06eb3892409da95d8730fb77a4d2/users/2c951d7c31ce4628a98282934ce66eee/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:37:05.840830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ecd4-e77f-45cc-a92b-55814deca809 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.841146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ecd4-e77f-45cc-a92b-55814deca809 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.841433 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ecd4-e77f-45cc-a92b-55814deca809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.877361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eb52ecd4-e77f-45cc-a92b-55814deca809 None None] MFA Rules not processed for user `2c951d7c31ce4628a98282934ce66eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:05.878660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb52ecd4-e77f-45cc-a92b-55814deca809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:05.953734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713662-98bd-42e5-9b33-93e62572d147 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:05.954068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713662-98bd-42e5-9b33-93e62572d147 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:05.954294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713662-98bd-42e5-9b33-93e62572d147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:05.996871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5c713662-98bd-42e5-9b33-93e62572d147 None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:06.001719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5c713662-98bd-42e5-9b33-93e62572d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:06.015783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1194/2382] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:06.029301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52ecd4-e77f-45cc-a92b-55814deca809 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:06.034721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb52ecd4-e77f-45cc-a92b-55814deca809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:06.069010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:06.105050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:06.152528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1189/2383] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:37:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:06.160903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52ecd4-e77f-45cc-a92b-55814deca809 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:06.166561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39ea7-f09b-4ef5-802a-fa9a44359b67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:06.167315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39ea7-f09b-4ef5-802a-fa9a44359b67 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:06.167555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713662-98bd-42e5-9b33-93e62572d147 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:06.167676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39ea7-f09b-4ef5-802a-fa9a44359b67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:06.167869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39ea7-f09b-4ef5-802a-fa9a44359b67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:06.169237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5c713662-98bd-42e5-9b33-93e62572d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:06.178482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf39ea7-f09b-4ef5-802a-fa9a44359b67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:06.179983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf39ea7-f09b-4ef5-802a-fa9a44359b67 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:06.190027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1195/2384] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:06.256047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713662-98bd-42e5-9b33-93e62572d147 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:06.261549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f80af-ba52-4389-bc7a-45cdbdd99be4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:06.262416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f80af-ba52-4389-bc7a-45cdbdd99be4 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:06.263258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f80af-ba52-4389-bc7a-45cdbdd99be4 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:06.263526 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f80af-ba52-4389-bc7a-45cdbdd99be4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:06.273082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f80af-ba52-4389-bc7a-45cdbdd99be4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:06.274651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f80af-ba52-4389-bc7a-45cdbdd99be4 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:06.282945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1190/2385] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 11:37:07.641220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e7f7-dc19-458d-ad51-3f29c56bc690 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:07.641751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e7f7-dc19-458d-ad51-3f29c56bc690 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:07.641751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e7f7-dc19-458d-ad51-3f29c56bc690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:07.681265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0205e7f7-dc19-458d-ad51-3f29c56bc690 None None] MFA Rules not processed for user `2c951d7c31ce4628a98282934ce66eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:07.682505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0205e7f7-dc19-458d-ad51-3f29c56bc690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:07.701568 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1196/2386] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:07.907076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8ab2a-7297-486f-aad8-b2653eb5f854 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:07.907639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8ab2a-7297-486f-aad8-b2653eb5f854 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:07.907879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8ab2a-7297-486f-aad8-b2653eb5f854 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:07.909489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1191/2387] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:37:07.918883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c81ed-0366-4cdf-8ff1-508650a0010f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:07.919430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c81ed-0366-4cdf-8ff1-508650a0010f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:07.920020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c81ed-0366-4cdf-8ff1-508650a0010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:07.966610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d50c81ed-0366-4cdf-8ff1-508650a0010f None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:07.973093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d50c81ed-0366-4cdf-8ff1-508650a0010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:08.163640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1197/2388] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:37:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:08.175004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8ab2a-7297-486f-aad8-b2653eb5f854 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:08.177277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-32b8ab2a-7297-486f-aad8-b2653eb5f854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:08.276769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8ab2a-7297-486f-aad8-b2653eb5f854 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:08.284204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437419d8-eae2-46d1-8f0f-e47f2f5db700 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb50ee2f9ccd4a258f3396074db66e74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:08.284828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437419d8-eae2-46d1-8f0f-e47f2f5db700 service glance] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:08.285111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437419d8-eae2-46d1-8f0f-e47f2f5db700 service glance] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:08.286091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437419d8-eae2-46d1-8f0f-e47f2f5db700 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:08.299978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437419d8-eae2-46d1-8f0f-e47f2f5db700 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:08.303435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437419d8-eae2-46d1-8f0f-e47f2f5db700 service glance] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:08.318782 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1192/2389] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:08.462151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bf3d6-8e15-44ad-a147-affca4852490 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:08.462503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bf3d6-8e15-44ad-a147-affca4852490 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:08.462713 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bf3d6-8e15-44ad-a147-affca4852490 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:08.464408 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1198/2390] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:37:08.477617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289072e-3a83-48ae-adf5-0ebc02cacdfa None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:08.477903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289072e-3a83-48ae-adf5-0ebc02cacdfa None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:08.478204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289072e-3a83-48ae-adf5-0ebc02cacdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:08.518476 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7289072e-3a83-48ae-adf5-0ebc02cacdfa None None] MFA Rules not processed for user `e0f654bfe8364490a322b88433dd8fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:08.520443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7289072e-3a83-48ae-adf5-0ebc02cacdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:08.669903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1193/2391] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:37:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:08.693275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bf3d6-8e15-44ad-a147-affca4852490 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:08.699564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-065bf3d6-8e15-44ad-a147-affca4852490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:08.721700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bf3d6-8e15-44ad-a147-affca4852490 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:08.726162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26766-ab20-4b28-9e8c-1946f1186317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:08.728128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26766-ab20-4b28-9e8c-1946f1186317 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:08.728670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26766-ab20-4b28-9e8c-1946f1186317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:08.729311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26766-ab20-4b28-9e8c-1946f1186317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:08.741353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f26766-ab20-4b28-9e8c-1946f1186317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:08.753478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f26766-ab20-4b28-9e8c-1946f1186317 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:08.775202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1199/2392] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:08.949934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedfcc3-3433-4713-ba2d-b6b163620f7f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:08.954425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedfcc3-3433-4713-ba2d-b6b163620f7f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:08.954877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedfcc3-3433-4713-ba2d-b6b163620f7f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:08.961395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1194/2393] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:37:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:37:08.972759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d1b3-ab2d-4a29-9dfe-0274f1108516 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:08.973637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d1b3-ab2d-4a29-9dfe-0274f1108516 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:08.973918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d1b3-ab2d-4a29-9dfe-0274f1108516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:09.002215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a841d1b3-ab2d-4a29-9dfe-0274f1108516 None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:09.003661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a841d1b3-ab2d-4a29-9dfe-0274f1108516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:09.020404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1200/2394] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:37:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:37:09.027400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedfcc3-3433-4713-ba2d-b6b163620f7f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:09.045137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedfcc3-3433-4713-ba2d-b6b163620f7f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:09.049871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00441869-b2bd-4ede-96a6-2568f2e4cdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:09.050510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00441869-b2bd-4ede-96a6-2568f2e4cdad service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:09.051602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00441869-b2bd-4ede-96a6-2568f2e4cdad service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:09.051897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00441869-b2bd-4ede-96a6-2568f2e4cdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:09.060410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:09.065079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00441869-b2bd-4ede-96a6-2568f2e4cdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:09.067209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00441869-b2bd-4ede-96a6-2568f2e4cdad service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:09.086244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1195/2395] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:37:13.108445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d965e-1b59-4def-b30a-4ed9933b2e63 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:13.109442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d965e-1b59-4def-b30a-4ed9933b2e63 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:13.109953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d965e-1b59-4def-b30a-4ed9933b2e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:13.147534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-616d965e-1b59-4def-b30a-4ed9933b2e63 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:13.153333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-616d965e-1b59-4def-b30a-4ed9933b2e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:13.237686 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1201/2396] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:13.255356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00441869-b2bd-4ede-96a6-2568f2e4cdad service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:13.256671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-00441869-b2bd-4ede-96a6-2568f2e4cdad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:13.278795 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00441869-b2bd-4ede-96a6-2568f2e4cdad service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:13.286519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb211f-ecab-40b3-b2a8-3070639ee3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:13.287765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb211f-ecab-40b3-b2a8-3070639ee3d2 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:13.288307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb211f-ecab-40b3-b2a8-3070639ee3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:13.288851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb211f-ecab-40b3-b2a8-3070639ee3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:13.302012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb211f-ecab-40b3-b2a8-3070639ee3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:13.304117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb211f-ecab-40b3-b2a8-3070639ee3d2 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:13.350787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1196/2397] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:16.401770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39304c-e7d4-49e8-9a37-3ede9cec8aab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:16.402324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39304c-e7d4-49e8-9a37-3ede9cec8aab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:16.402426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39304c-e7d4-49e8-9a37-3ede9cec8aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:16.427425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fc39304c-e7d4-49e8-9a37-3ede9cec8aab None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:16.429067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc39304c-e7d4-49e8-9a37-3ede9cec8aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:16.437618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1202/2398] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:37:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:16.451989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb211f-ecab-40b3-b2a8-3070639ee3d2 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:16.466657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb211f-ecab-40b3-b2a8-3070639ee3d2 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:16.473363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52237a-750e-43e9-a3b1-47aa9e8f3469 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:16.474392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52237a-750e-43e9-a3b1-47aa9e8f3469 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:16.474862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52237a-750e-43e9-a3b1-47aa9e8f3469 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:16.475343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52237a-750e-43e9-a3b1-47aa9e8f3469 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:16.489208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52237a-750e-43e9-a3b1-47aa9e8f3469 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:16.491246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52237a-750e-43e9-a3b1-47aa9e8f3469 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:16.501191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1197/2399] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:37:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:37:16.560114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3dca2-04d1-4986-b40a-b3f2992e8fd9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:16.560630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3dca2-04d1-4986-b40a-b3f2992e8fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:16.561108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3dca2-04d1-4986-b40a-b3f2992e8fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:16.602596 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-97c3dca2-04d1-4986-b40a-b3f2992e8fd9 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:16.607017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-97c3dca2-04d1-4986-b40a-b3f2992e8fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:16.625301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1203/2400] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:16.655541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52237a-750e-43e9-a3b1-47aa9e8f3469 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:16.675755 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52237a-750e-43e9-a3b1-47aa9e8f3469 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:16.685570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6dd26-9d7b-4f75-9945-82344fbc68fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:16.686499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6dd26-9d7b-4f75-9945-82344fbc68fc service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:16.688200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6dd26-9d7b-4f75-9945-82344fbc68fc service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:16.688720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6dd26-9d7b-4f75-9945-82344fbc68fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:16.698963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6dd26-9d7b-4f75-9945-82344fbc68fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:16.700875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6dd26-9d7b-4f75-9945-82344fbc68fc service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:16.712386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1198/2401] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:26.228869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b556222-5d68-435b-b0ef-88223d82dfca None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.228869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b556222-5d68-435b-b0ef-88223d82dfca None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.228869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b556222-5d68-435b-b0ef-88223d82dfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.243187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8b556222-5d68-435b-b0ef-88223d82dfca None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:26.244603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b556222-5d68-435b-b0ef-88223d82dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:26.259242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1204/2402] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 31 11:37:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:26.267897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6dd26-9d7b-4f75-9945-82344fbc68fc service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:26.279962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6dd26-9d7b-4f75-9945-82344fbc68fc service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:26.287687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe98c0-ae3e-4818-98d8-b0a8c17e5751 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:26.288310 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe98c0-ae3e-4818-98d8-b0a8c17e5751 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.288591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe98c0-ae3e-4818-98d8-b0a8c17e5751 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.288863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe98c0-ae3e-4818-98d8-b0a8c17e5751 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.310005 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe98c0-ae3e-4818-98d8-b0a8c17e5751 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:26.311705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe98c0-ae3e-4818-98d8-b0a8c17e5751 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:26.321943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1199/2403] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:37:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:37:28.549033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b556222-5d68-435b-b0ef-88223d82dfca None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:28.551059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b556222-5d68-435b-b0ef-88223d82dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:28.566079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b556222-5d68-435b-b0ef-88223d82dfca None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:28.571834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:28.572529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:28.572816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:28.573089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] PATH_INFO: `/v3/users/e06954cb663e428aaa5c75fef66c0f93` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:28.574242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06954cb663e428aaa5c75fef66c0f93)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:28.576226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:28.578517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:28.624921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06954cb663e428aaa5c75fef66c0f93'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.637763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06954cb663e428aaa5c75fef66c0f93'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.644791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06954cb663e428aaa5c75fef66c0f93'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.652904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06954cb663e428aaa5c75fef66c0f93'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.653674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-70b6ef39-d18a-4216-8172-8ce2e6b6688f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06954cb663e428aaa5c75fef66c0f93'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.662029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1205/2404] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:28 2022] DELETE /identity/v3/users/e06954cb663e428aaa5c75fef66c0f93 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:28.926311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe98c0-ae3e-4818-98d8-b0a8c17e5751 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:28.948066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe98c0-ae3e-4818-98d8-b0a8c17e5751 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:29.026262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:29.026947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:29.027222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:29.027488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] PATH_INFO: `/v3/projects/7593c5704a994eac85594fe0fd68ebfb` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:29.028583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7593c5704a994eac85594fe0fd68ebfb)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:29.030605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:29.077180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7593c5704a994eac85594fe0fd68ebfb', 'request_id': 'req-635f637d-d965-40ba-86f3-e9f038064676'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:29.084275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7593c5704a994eac85594fe0fd68ebfb', 'request_id': 'req-635f637d-d965-40ba-86f3-e9f038064676'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:29.090549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7593c5704a994eac85594fe0fd68ebfb', 'request_id': 'req-635f637d-d965-40ba-86f3-e9f038064676'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:29.104410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] The token cache is being invalidate because project 7593c5704a994eac85594fe0fd68ebfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:29.104694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:29.105308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:29.106845 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1200/2405] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:28 2022] DELETE /identity/v3/projects/7593c5704a994eac85594fe0fd68ebfb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:31.136042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f4c4-1292-4c04-b449-5d51c9ddb8da None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:31.136591 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f4c4-1292-4c04-b449-5d51c9ddb8da None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:31.136591 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f4c4-1292-4c04-b449-5d51c9ddb8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:31.156592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5b37f4c4-1292-4c04-b449-5d51c9ddb8da None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:31.158312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5b37f4c4-1292-4c04-b449-5d51c9ddb8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:31.228587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1206/2406] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:31.246216 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:31.247787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:31.282958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:31.338786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f637d-d965-40ba-86f3-e9f038064676 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:31.338786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6111a1-54a8-4ffc-9c98-93789aa54bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:31.338786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6111a1-54a8-4ffc-9c98-93789aa54bb4 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:31.338786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6111a1-54a8-4ffc-9c98-93789aa54bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:31.339241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6111a1-54a8-4ffc-9c98-93789aa54bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:31.346259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6111a1-54a8-4ffc-9c98-93789aa54bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:31.348533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6111a1-54a8-4ffc-9c98-93789aa54bb4 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:31.358277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1201/2407] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:35.321407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c733d7-e6bc-44c8-84b0-d5e426a61cc3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:35.321921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c733d7-e6bc-44c8-84b0-d5e426a61cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:35.322023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c733d7-e6bc-44c8-84b0-d5e426a61cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:35.341103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-04c733d7-e6bc-44c8-84b0-d5e426a61cc3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:35.342288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-04c733d7-e6bc-44c8-84b0-d5e426a61cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:35.350020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1207/2408] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:35.375443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6111a1-54a8-4ffc-9c98-93789aa54bb4 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:35.376822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ef6111a1-54a8-4ffc-9c98-93789aa54bb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:35.392125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6111a1-54a8-4ffc-9c98-93789aa54bb4 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:35.397684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475fb9-7f23-4af7-970b-14837731828c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:35.398268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475fb9-7f23-4af7-970b-14837731828c service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:35.398580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475fb9-7f23-4af7-970b-14837731828c service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:35.398887 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475fb9-7f23-4af7-970b-14837731828c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:35.406916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475fb9-7f23-4af7-970b-14837731828c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:35.408492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475fb9-7f23-4af7-970b-14837731828c service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:35.418329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1202/2409] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:39.974124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f327-b04f-4c71-bcc9-e9d569918c9d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:39.974609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f327-b04f-4c71-bcc9-e9d569918c9d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:39.974744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f327-b04f-4c71-bcc9-e9d569918c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:39.995004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-54a0f327-b04f-4c71-bcc9-e9d569918c9d None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:39.996238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-54a0f327-b04f-4c71-bcc9-e9d569918c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:40.058143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1208/2410] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 31 11:37:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:40.070911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475fb9-7f23-4af7-970b-14837731828c service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:40.072371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-24475fb9-7f23-4af7-970b-14837731828c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:40.085411 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0f327-b04f-4c71-bcc9-e9d569918c9d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:40.086901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-54a0f327-b04f-4c71-bcc9-e9d569918c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:40.111270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:40.154667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475fb9-7f23-4af7-970b-14837731828c service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:40.160008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f3e52-e18e-457d-a2c8-936bde1da076 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:40.161323 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f3e52-e18e-457d-a2c8-936bde1da076 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:40.161713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f3e52-e18e-457d-a2c8-936bde1da076 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:40.161994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f3e52-e18e-457d-a2c8-936bde1da076 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:40.166320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0f327-b04f-4c71-bcc9-e9d569918c9d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:40.170296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f3e52-e18e-457d-a2c8-936bde1da076 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:40.171395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a469c24-6363-4b39-993d-9d7e12996e25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:40.171986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f3e52-e18e-457d-a2c8-936bde1da076 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:40.172109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a469c24-6363-4b39-993d-9d7e12996e25 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:40.172255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a469c24-6363-4b39-993d-9d7e12996e25 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:40.172544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a469c24-6363-4b39-993d-9d7e12996e25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:40.174212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a469c24-6363-4b39-993d-9d7e12996e25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:40.180225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1203/2411] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:37:40.186231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a469c24-6363-4b39-993d-9d7e12996e25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:40.187863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a469c24-6363-4b39-993d-9d7e12996e25 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:40.198902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1209/2412] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:37:40.570839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279171-61f6-43f0-9d73-ced88af15240 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:40.571123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279171-61f6-43f0-9d73-ced88af15240 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:40.571393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279171-61f6-43f0-9d73-ced88af15240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:40.591643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3b279171-61f6-43f0-9d73-ced88af15240 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:40.592913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3b279171-61f6-43f0-9d73-ced88af15240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:40.601314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1204/2413] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:40.617485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a469c24-6363-4b39-993d-9d7e12996e25 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:40.630255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a469c24-6363-4b39-993d-9d7e12996e25 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:40.635752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19046ead-20e8-4913-bdeb-68101289802e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:40.636344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19046ead-20e8-4913-bdeb-68101289802e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:40.636622 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19046ead-20e8-4913-bdeb-68101289802e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:40.636895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19046ead-20e8-4913-bdeb-68101289802e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:40.644981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19046ead-20e8-4913-bdeb-68101289802e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:40.646663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19046ead-20e8-4913-bdeb-68101289802e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:40.656538 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1210/2414] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:44.293267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682cb1-c646-45f8-aed9-daa70cba1f6c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:44.293739 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682cb1-c646-45f8-aed9-daa70cba1f6c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:44.293827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682cb1-c646-45f8-aed9-daa70cba1f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:44.313484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-75682cb1-c646-45f8-aed9-daa70cba1f6c None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:44.314758 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-75682cb1-c646-45f8-aed9-daa70cba1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:44.323073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1205/2415] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:37:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:44.334675 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19046ead-20e8-4913-bdeb-68101289802e service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:44.352028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19046ead-20e8-4913-bdeb-68101289802e service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:44.357007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eef809-1b84-45a7-badc-5d00b42511a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:44.357600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eef809-1b84-45a7-badc-5d00b42511a9 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:44.357878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eef809-1b84-45a7-badc-5d00b42511a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:44.358151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eef809-1b84-45a7-badc-5d00b42511a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:44.367121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eef809-1b84-45a7-badc-5d00b42511a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:44.368703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eef809-1b84-45a7-badc-5d00b42511a9 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:44.376575 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1211/2416] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:37:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:37:44.934407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629640-e1f0-4503-986a-af617560f3bf None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:44.934790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629640-e1f0-4503-986a-af617560f3bf None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:44.934994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629640-e1f0-4503-986a-af617560f3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:44.958819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-38629640-e1f0-4503-986a-af617560f3bf None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:44.960055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-38629640-e1f0-4503-986a-af617560f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:44.967549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1206/2417] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 31 11:37:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:44.980719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eef809-1b84-45a7-badc-5d00b42511a9 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:44.991917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eef809-1b84-45a7-badc-5d00b42511a9 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:44.997343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a54af-4131-4ad5-b439-b7bcc5692a96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:44.998332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a54af-4131-4ad5-b439-b7bcc5692a96 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:44.998626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a54af-4131-4ad5-b439-b7bcc5692a96 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:44.998952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a54af-4131-4ad5-b439-b7bcc5692a96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.008637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a54af-4131-4ad5-b439-b7bcc5692a96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.010269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a54af-4131-4ad5-b439-b7bcc5692a96 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.018477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1212/2418] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:37:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:37:45.253735 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee189f-21f3-488a-9a3f-525219ec99d4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.254670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee189f-21f3-488a-9a3f-525219ec99d4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.255210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee189f-21f3-488a-9a3f-525219ec99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.274923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-93ee189f-21f3-488a-9a3f-525219ec99d4 None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:45.276251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-93ee189f-21f3-488a-9a3f-525219ec99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:45.283353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1207/2419] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:37:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:45.296530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a54af-4131-4ad5-b439-b7bcc5692a96 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:45.308909 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a54af-4131-4ad5-b439-b7bcc5692a96 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:45.314306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97555b77-6a40-4d42-8f8f-fc4aaea158f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:45.314940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97555b77-6a40-4d42-8f8f-fc4aaea158f1 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.315218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97555b77-6a40-4d42-8f8f-fc4aaea158f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.315529 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97555b77-6a40-4d42-8f8f-fc4aaea158f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.326597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97555b77-6a40-4d42-8f8f-fc4aaea158f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.328199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97555b77-6a40-4d42-8f8f-fc4aaea158f1 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.336943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1213/2420] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:37:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:37:45.653644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2d83-28c4-4329-82d0-4e3cfd3a89f6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.654104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2d83-28c4-4329-82d0-4e3cfd3a89f6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.654196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2d83-28c4-4329-82d0-4e3cfd3a89f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.673055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-703d2d83-28c4-4329-82d0-4e3cfd3a89f6 None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:45.674236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-703d2d83-28c4-4329-82d0-4e3cfd3a89f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:45.681813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1208/2421] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 31 11:37:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:45.696419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97555b77-6a40-4d42-8f8f-fc4aaea158f1 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:45.708904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97555b77-6a40-4d42-8f8f-fc4aaea158f1 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:45.714071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67484b6-4901-4a57-a527-b08a9ee0d764 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:45.714722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67484b6-4901-4a57-a527-b08a9ee0d764 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.715010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67484b6-4901-4a57-a527-b08a9ee0d764 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.715286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67484b6-4901-4a57-a527-b08a9ee0d764 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.723345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67484b6-4901-4a57-a527-b08a9ee0d764 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.724939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67484b6-4901-4a57-a527-b08a9ee0d764 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.733091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1214/2422] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:37:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 11:37:47.823933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2d83-28c4-4329-82d0-4e3cfd3a89f6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:47.825336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-703d2d83-28c4-4329-82d0-4e3cfd3a89f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:47.838962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2d83-28c4-4329-82d0-4e3cfd3a89f6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:47.843450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:47.844059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:47.844334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:47.844604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] PATH_INFO: `/v3/users/2c951d7c31ce4628a98282934ce66eee` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:47.845720 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c951d7c31ce4628a98282934ce66eee)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:47.847664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:47.894334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c951d7c31ce4628a98282934ce66eee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:47.900925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c951d7c31ce4628a98282934ce66eee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:47.901638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c951d7c31ce4628a98282934ce66eee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:47.902775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:47.915277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c951d7c31ce4628a98282934ce66eee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:47.922114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c951d7c31ce4628a98282934ce66eee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:47.928625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1209/2423] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:47 2022] DELETE /identity/v3/users/2c951d7c31ce4628a98282934ce66eee => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:37:47.933049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a960cc9-0705-4107-ab88-5214297b963f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:47.933547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a960cc9-0705-4107-ab88-5214297b963f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:47.933645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a960cc9-0705-4107-ab88-5214297b963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:47.953964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0a960cc9-0705-4107-ab88-5214297b963f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:47.955212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0a960cc9-0705-4107-ab88-5214297b963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:48.012518 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1215/2424] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:48.022471 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:48.023942 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:48.080456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a2ff5-7ac5-4660-a264-11b3e2a38a18 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:48.084517 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7195-75a2-46b2-9ca8-58757a744875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:48.085117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7195-75a2-46b2-9ca8-58757a744875 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.085398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7195-75a2-46b2-9ca8-58757a744875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.085706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7195-75a2-46b2-9ca8-58757a744875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.095999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e7195-75a2-46b2-9ca8-58757a744875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:48.097530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e7195-75a2-46b2-9ca8-58757a744875 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:48.107699 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1210/2425] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:48.276708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a960cc9-0705-4107-ab88-5214297b963f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:48.278216 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0a960cc9-0705-4107-ab88-5214297b963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:48.290476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a960cc9-0705-4107-ab88-5214297b963f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:48.295078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:48.295711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.295987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.296445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] PATH_INFO: `/v3/projects/356a06eb3892409da95d8730fb77a4d2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.297370 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=356a06eb3892409da95d8730fb77a4d2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:48.299520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:48.340116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:48.350149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356a06eb3892409da95d8730fb77a4d2', 'request_id': 'req-64133dc6-1f4f-406e-9fb1-a0a139c856ba'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:48.357739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356a06eb3892409da95d8730fb77a4d2', 'request_id': 'req-64133dc6-1f4f-406e-9fb1-a0a139c856ba'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:48.363943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356a06eb3892409da95d8730fb77a4d2', 'request_id': 'req-64133dc6-1f4f-406e-9fb1-a0a139c856ba'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:48.375381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] The token cache is being invalidate because project 356a06eb3892409da95d8730fb77a4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:48.375674 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:48.376358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-64133dc6-1f4f-406e-9fb1-a0a139c856ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:48.377859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1216/2426] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:48 2022] DELETE /identity/v3/projects/356a06eb3892409da95d8730fb77a4d2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:48.383532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87556e-6bec-42ea-b418-ed275df3b6e4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.383948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87556e-6bec-42ea-b418-ed275df3b6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.384310 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87556e-6bec-42ea-b418-ed275df3b6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.404585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4f87556e-6bec-42ea-b418-ed275df3b6e4 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:48.405949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4f87556e-6bec-42ea-b418-ed275df3b6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:48.477630 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1211/2427] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:37:48.487858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8be3c-d1e0-4571-82a4-e253c6c91f0a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.488143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8be3c-d1e0-4571-82a4-e253c6c91f0a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.488469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8be3c-d1e0-4571-82a4-e253c6c91f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.508944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8be8be3c-d1e0-4571-82a4-e253c6c91f0a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:48.510149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8be8be3c-d1e0-4571-82a4-e253c6c91f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:48.517983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1217/2428] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:48.522857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87556e-6bec-42ea-b418-ed275df3b6e4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:48.532518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87556e-6bec-42ea-b418-ed275df3b6e4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:48.537709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee19c4-91e3-471c-9edb-980f76f59267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:48.538302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee19c4-91e3-471c-9edb-980f76f59267 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.538584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee19c4-91e3-471c-9edb-980f76f59267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.538889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee19c4-91e3-471c-9edb-980f76f59267 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.539572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee19c4-91e3-471c-9edb-980f76f59267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:37:48.539878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee19c4-91e3-471c-9edb-980f76f59267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:48.541475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee19c4-91e3-471c-9edb-980f76f59267 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:48.553057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1212/2429] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:37:48.557154 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8be3c-d1e0-4571-82a4-e253c6c91f0a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:48.566449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8be3c-d1e0-4571-82a4-e253c6c91f0a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:48.571212 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a71e7-4bf8-4328-9091-a32b77fc4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:48.571806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a71e7-4bf8-4328-9091-a32b77fc4e91 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.572087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a71e7-4bf8-4328-9091-a32b77fc4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.572358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a71e7-4bf8-4328-9091-a32b77fc4e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.573007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a71e7-4bf8-4328-9091-a32b77fc4e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:48.574931 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a71e7-4bf8-4328-9091-a32b77fc4e91 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:48.602561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1218/2430] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:48 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:48.606377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee19c4-91e3-471c-9edb-980f76f59267 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:48.617378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee19c4-91e3-471c-9edb-980f76f59267 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:48.673639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29addc8-c9eb-4135-9ab8-3e08e2912298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:48.674208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29addc8-c9eb-4135-9ab8-3e08e2912298 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.674491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29addc8-c9eb-4135-9ab8-3e08e2912298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.674794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29addc8-c9eb-4135-9ab8-3e08e2912298 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.675428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29addc8-c9eb-4135-9ab8-3e08e2912298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:48.677876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29addc8-c9eb-4135-9ab8-3e08e2912298 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:48.687569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:48.708288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1213/2431] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:48 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:37:48.712430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a71e7-4bf8-4328-9091-a32b77fc4e91 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:48.723400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a71e7-4bf8-4328-9091-a32b77fc4e91 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:48.728392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f9017-7916-44b8-8882-359aa304b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:48.729006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f9017-7916-44b8-8882-359aa304b27f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.729343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f9017-7916-44b8-8882-359aa304b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.729723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f9017-7916-44b8-8882-359aa304b27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.730372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f9017-7916-44b8-8882-359aa304b27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:48.732024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f9017-7916-44b8-8882-359aa304b27f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:48.746334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1219/2432] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:48.747643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29addc8-c9eb-4135-9ab8-3e08e2912298 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:48.759378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29addc8-c9eb-4135-9ab8-3e08e2912298 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:48.764581 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45240463-7aea-4829-8f87-a219e8a29c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:48.765847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45240463-7aea-4829-8f87-a219e8a29c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.766111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45240463-7aea-4829-8f87-a219e8a29c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.766380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45240463-7aea-4829-8f87-a219e8a29c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.767091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45240463-7aea-4829-8f87-a219e8a29c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:48.768697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45240463-7aea-4829-8f87-a219e8a29c80 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:48.780154 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1214/2433] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:48.784233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f9017-7916-44b8-8882-359aa304b27f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:48.794404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f9017-7916-44b8-8882-359aa304b27f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:48.799588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fede1f-2410-4849-bdc3-28cbe1df8513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:48.800246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fede1f-2410-4849-bdc3-28cbe1df8513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.800528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fede1f-2410-4849-bdc3-28cbe1df8513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.800835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fede1f-2410-4849-bdc3-28cbe1df8513 admin admin] PATH_INFO: `/v3/projects/e3c91374ff9942f6a1d9a488e46507f6/users/1d77d47dbe764730aecc3e6506c3b0f0/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.816992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fede1f-2410-4849-bdc3-28cbe1df8513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c91374ff9942f6a1d9a488e46507f6, user_id=1d77d47dbe764730aecc3e6506c3b0f0, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:48.819725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fede1f-2410-4849-bdc3-28cbe1df8513 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:48.834284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1220/2434] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:48 2022] PUT /identity/v3/projects/e3c91374ff9942f6a1d9a488e46507f6/users/1d77d47dbe764730aecc3e6506c3b0f0/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:48.842565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25340d1-006f-49f5-9ce8-7d1e1c98ff4b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.843089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25340d1-006f-49f5-9ce8-7d1e1c98ff4b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.843268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25340d1-006f-49f5-9ce8-7d1e1c98ff4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:48.863313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e25340d1-006f-49f5-9ce8-7d1e1c98ff4b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:48.864477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e25340d1-006f-49f5-9ce8-7d1e1c98ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:48.923051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1215/2435] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:48.932885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fede1f-2410-4849-bdc3-28cbe1df8513 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:48.934606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00fede1f-2410-4849-bdc3-28cbe1df8513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:48.992231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fede1f-2410-4849-bdc3-28cbe1df8513 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:48.996060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0bb0a-e84b-4f10-893b-ff50ceab183e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:48.996760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0bb0a-e84b-4f10-893b-ff50ceab183e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:48.997062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0bb0a-e84b-4f10-893b-ff50ceab183e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:48.997340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0bb0a-e84b-4f10-893b-ff50ceab183e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:49.007184 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0bb0a-e84b-4f10-893b-ff50ceab183e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:49.008682 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0bb0a-e84b-4f10-893b-ff50ceab183e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:49.018138 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1221/2436] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:53.424327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f7b80-8fa2-4d9a-95e8-00b7beac629a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.425201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f7b80-8fa2-4d9a-95e8-00b7beac629a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.425473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f7b80-8fa2-4d9a-95e8-00b7beac629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.471347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5f3f7b80-8fa2-4d9a-95e8-00b7beac629a None None] MFA Rules not processed for user `1d77d47dbe764730aecc3e6506c3b0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:53.472631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5f3f7b80-8fa2-4d9a-95e8-00b7beac629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:53.560769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1216/2437] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:53.565421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0bb0a-e84b-4f10-893b-ff50ceab183e service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.576709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0bb0a-e84b-4f10-893b-ff50ceab183e service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.581970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18741466-7afd-45fe-b199-4ccecab7fbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.583326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18741466-7afd-45fe-b199-4ccecab7fbbe admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.583670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18741466-7afd-45fe-b199-4ccecab7fbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.584182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18741466-7afd-45fe-b199-4ccecab7fbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.585025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18741466-7afd-45fe-b199-4ccecab7fbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.587012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18741466-7afd-45fe-b199-4ccecab7fbbe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.626050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1222/2438] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:53 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:53.627322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f7b80-8fa2-4d9a-95e8-00b7beac629a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.639829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f7b80-8fa2-4d9a-95e8-00b7beac629a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.710103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268fd8-d613-4f9c-b404-bc08079d3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.710756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268fd8-d613-4f9c-b404-bc08079d3b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.711037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268fd8-d613-4f9c-b404-bc08079d3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.711303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268fd8-d613-4f9c-b404-bc08079d3b4c admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.711960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e268fd8-d613-4f9c-b404-bc08079d3b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.713890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e268fd8-d613-4f9c-b404-bc08079d3b4c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.734095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:53.742248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1217/2439] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:53 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:53.743777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18741466-7afd-45fe-b199-4ccecab7fbbe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.754828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18741466-7afd-45fe-b199-4ccecab7fbbe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.759494 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c453-0557-4418-ad43-4bb6cee01033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.760108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c453-0557-4418-ad43-4bb6cee01033 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.760385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c453-0557-4418-ad43-4bb6cee01033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.760653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c453-0557-4418-ad43-4bb6cee01033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.761294 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095c453-0557-4418-ad43-4bb6cee01033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.762951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095c453-0557-4418-ad43-4bb6cee01033 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.774711 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1223/2440] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:37:53.778885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268fd8-d613-4f9c-b404-bc08079d3b4c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.790138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268fd8-d613-4f9c-b404-bc08079d3b4c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.795048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99283b6-b425-4e64-b7ef-4388cae507fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.795791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99283b6-b425-4e64-b7ef-4388cae507fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.796133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99283b6-b425-4e64-b7ef-4388cae507fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.796474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99283b6-b425-4e64-b7ef-4388cae507fa admin admin] PATH_INFO: `/v3/projects/5e989f0bbf5e44068fbc4d81a516fd87/users/ebf1089b392a45c8ad6bd64db8ea441e/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.813770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99283b6-b425-4e64-b7ef-4388cae507fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e989f0bbf5e44068fbc4d81a516fd87, user_id=ebf1089b392a45c8ad6bd64db8ea441e, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.817126 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99283b6-b425-4e64-b7ef-4388cae507fa admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.831870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1218/2441] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:53 2022] PUT /identity/v3/projects/5e989f0bbf5e44068fbc4d81a516fd87/users/ebf1089b392a45c8ad6bd64db8ea441e/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:37:53.836839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c453-0557-4418-ad43-4bb6cee01033 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.846934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c453-0557-4418-ad43-4bb6cee01033 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.879776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:53.912633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5bfe-ed95-4815-a4a2-3824b7b230ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.913247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5bfe-ed95-4815-a4a2-3824b7b230ed admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.915810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5bfe-ed95-4815-a4a2-3824b7b230ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.915810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5bfe-ed95-4815-a4a2-3824b7b230ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.915810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d5bfe-ed95-4815-a4a2-3824b7b230ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.919063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d5bfe-ed95-4815-a4a2-3824b7b230ed admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.932907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1224/2442] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:53.938829 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99283b6-b425-4e64-b7ef-4388cae507fa admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.949990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99283b6-b425-4e64-b7ef-4388cae507fa admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.954596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41068e1-f9bd-4169-9d16-b1746fdb631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.955298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41068e1-f9bd-4169-9d16-b1746fdb631d admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.955571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41068e1-f9bd-4169-9d16-b1746fdb631d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.955869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41068e1-f9bd-4169-9d16-b1746fdb631d admin admin] PATH_INFO: `/v3/projects/5e989f0bbf5e44068fbc4d81a516fd87/users/ebf1089b392a45c8ad6bd64db8ea441e/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.958015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41068e1-f9bd-4169-9d16-b1746fdb631d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e989f0bbf5e44068fbc4d81a516fd87, user_id=ebf1089b392a45c8ad6bd64db8ea441e, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.960697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41068e1-f9bd-4169-9d16-b1746fdb631d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.976854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1219/2443] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:53 2022] PUT /identity/v3/projects/5e989f0bbf5e44068fbc4d81a516fd87/users/ebf1089b392a45c8ad6bd64db8ea441e/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:59.232404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82624aef-507d-4eed-9895-b7ee111082b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:59.232935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82624aef-507d-4eed-9895-b7ee111082b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:59.233137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82624aef-507d-4eed-9895-b7ee111082b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:59.278193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-82624aef-507d-4eed-9895-b7ee111082b2 None None] MFA Rules not processed for user `ebf1089b392a45c8ad6bd64db8ea441e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:59.279538 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-82624aef-507d-4eed-9895-b7ee111082b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:59.360001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1225/2444] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:37:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:59.372266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41068e1-f9bd-4169-9d16-b1746fdb631d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:59.374712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d41068e1-f9bd-4169-9d16-b1746fdb631d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:59.445114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41068e1-f9bd-4169-9d16-b1746fdb631d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:59.448776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32bb85-d987-4c59-b8e3-d330300f16ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb50ee2f9ccd4a258f3396074db66e74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:59.449386 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32bb85-d987-4c59-b8e3-d330300f16ed service glance] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:59.449664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32bb85-d987-4c59-b8e3-d330300f16ed service glance] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:59.449932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32bb85-d987-4c59-b8e3-d330300f16ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:59.531332 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32bb85-d987-4c59-b8e3-d330300f16ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:59.534178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32bb85-d987-4c59-b8e3-d330300f16ed service glance] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:59.547851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1220/2445] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:59.720325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0a520-77a5-45cf-9701-cc9012b080e7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:59.720716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0a520-77a5-45cf-9701-cc9012b080e7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:59.721069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0a520-77a5-45cf-9701-cc9012b080e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:59.769932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6db0a520-77a5-45cf-9701-cc9012b080e7 None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:59.771611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6db0a520-77a5-45cf-9701-cc9012b080e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:59.858540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1226/2446] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:37:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:59.875146 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32bb85-d987-4c59-b8e3-d330300f16ed service glance] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:59.878404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cc32bb85-d987-4c59-b8e3-d330300f16ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:59.967105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32bb85-d987-4c59-b8e3-d330300f16ed service glance] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:59.972128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054fd27-75f7-4105-aec4-545322e1f6c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:59.972813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054fd27-75f7-4105-aec4-545322e1f6c5 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:59.973294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054fd27-75f7-4105-aec4-545322e1f6c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:59.973730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054fd27-75f7-4105-aec4-545322e1f6c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:59.982972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054fd27-75f7-4105-aec4-545322e1f6c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:59.984580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054fd27-75f7-4105-aec4-545322e1f6c5 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:59.996792 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1221/2447] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:38:09.395367 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56500-4435-4ea3-b6c0-8ebf4762b88d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:09.395837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56500-4435-4ea3-b6c0-8ebf4762b88d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:09.395987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56500-4435-4ea3-b6c0-8ebf4762b88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:09.414995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ada56500-4435-4ea3-b6c0-8ebf4762b88d None None] MFA Rules not processed for user `1d77d47dbe764730aecc3e6506c3b0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:09.416179 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ada56500-4435-4ea3-b6c0-8ebf4762b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:09.423432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1227/2448] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:38:09.990956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:11.575759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054fd27-75f7-4105-aec4-545322e1f6c5 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:11.577215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1054fd27-75f7-4105-aec4-545322e1f6c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:11.598259 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb79eef-6a12-4244-92ef-0d1af929735c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:11.599143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb79eef-6a12-4244-92ef-0d1af929735c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:11.599637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb79eef-6a12-4244-92ef-0d1af929735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:11.620473 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4fb79eef-6a12-4244-92ef-0d1af929735c None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:11.621944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4fb79eef-6a12-4244-92ef-0d1af929735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:11.633102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1228/2449] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:38:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:38:11.650864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb79eef-6a12-4244-92ef-0d1af929735c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:11.658937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054fd27-75f7-4105-aec4-545322e1f6c5 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:11.664259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:11.664741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb79eef-6a12-4244-92ef-0d1af929735c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:11.665035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:11.665387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:11.665666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] PATH_INFO: `/v3/users/40ca5ae5716a4dae824a35cbdde9edc1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:11.666966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ca5ae5716a4dae824a35cbdde9edc1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:11.669016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:11.670814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44385c7d-b1eb-4fff-b3c1-904bda169666 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:11.671662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44385c7d-b1eb-4fff-b3c1-904bda169666 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:11.672133 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44385c7d-b1eb-4fff-b3c1-904bda169666 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:11.672580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44385c7d-b1eb-4fff-b3c1-904bda169666 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:11.683537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44385c7d-b1eb-4fff-b3c1-904bda169666 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:11.685238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44385c7d-b1eb-4fff-b3c1-904bda169666 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:11.694972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1229/2450] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:38:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:38:11.729395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ca5ae5716a4dae824a35cbdde9edc1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:11.739409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ca5ae5716a4dae824a35cbdde9edc1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:11.740249 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ca5ae5716a4dae824a35cbdde9edc1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:11.757692 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ca5ae5716a4dae824a35cbdde9edc1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:11.769963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-388ddc6c-f332-4e50-a6fb-0b5e3e4581ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ca5ae5716a4dae824a35cbdde9edc1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:11.779605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1222/2451] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:38:11 2022] DELETE /identity/v3/users/40ca5ae5716a4dae824a35cbdde9edc1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:12.065872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44385c7d-b1eb-4fff-b3c1-904bda169666 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:12.081515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44385c7d-b1eb-4fff-b3c1-904bda169666 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:12.172297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:12.210443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:12.212049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.212049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.212540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] PATH_INFO: `/v3/projects/d3df74f73d8d4458a6ea02df46a415d9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.213795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3df74f73d8d4458a6ea02df46a415d9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:12.216238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:12.300125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3df74f73d8d4458a6ea02df46a415d9', 'request_id': 'req-879a410d-0df5-4ba2-8523-8f2a7a7788ed'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:12.309461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3df74f73d8d4458a6ea02df46a415d9', 'request_id': 'req-879a410d-0df5-4ba2-8523-8f2a7a7788ed'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:12.327807 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3df74f73d8d4458a6ea02df46a415d9', 'request_id': 'req-879a410d-0df5-4ba2-8523-8f2a7a7788ed'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:12.341950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] The token cache is being invalidate because project d3df74f73d8d4458a6ea02df46a415d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:38:12.342320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:12.343209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-879a410d-0df5-4ba2-8523-8f2a7a7788ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:12.355866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1230/2452] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:38:12 2022] DELETE /identity/v3/projects/d3df74f73d8d4458a6ea02df46a415d9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:12.361872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f5bb0-f4e2-4c96-9089-6378a6aa16e6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.363056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f5bb0-f4e2-4c96-9089-6378a6aa16e6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.363659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f5bb0-f4e2-4c96-9089-6378a6aa16e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.385819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7d4f5bb0-f4e2-4c96-9089-6378a6aa16e6 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:12.387061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7d4f5bb0-f4e2-4c96-9089-6378a6aa16e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:12.513556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1223/2453] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:12.522895 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474399a4-f1d1-43ed-854b-d225d353a8fe None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.523550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474399a4-f1d1-43ed-854b-d225d353a8fe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.523978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474399a4-f1d1-43ed-854b-d225d353a8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.558890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-474399a4-f1d1-43ed-854b-d225d353a8fe None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:12.560241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-474399a4-f1d1-43ed-854b-d225d353a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:12.573280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f5bb0-f4e2-4c96-9089-6378a6aa16e6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:12.578542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1231/2454] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:12.584963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f5bb0-f4e2-4c96-9089-6378a6aa16e6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:12.590185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89cb4a-5450-4d8a-a20b-3f167f28ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:12.590992 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89cb4a-5450-4d8a-a20b-3f167f28ec8a admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.591374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89cb4a-5450-4d8a-a20b-3f167f28ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.591744 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89cb4a-5450-4d8a-a20b-3f167f28ec8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.592505 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89cb4a-5450-4d8a-a20b-3f167f28ec8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:38:12.592905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89cb4a-5450-4d8a-a20b-3f167f28ec8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:12.595202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89cb4a-5450-4d8a-a20b-3f167f28ec8a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:12.613911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474399a4-f1d1-43ed-854b-d225d353a8fe None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:12.619399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1224/2455] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:38:12.624947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474399a4-f1d1-43ed-854b-d225d353a8fe None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:12.630044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bdffb-48e5-4812-85ee-c51b8b6edf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:12.630724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bdffb-48e5-4812-85ee-c51b8b6edf11 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.631042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bdffb-48e5-4812-85ee-c51b8b6edf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.631316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bdffb-48e5-4812-85ee-c51b8b6edf11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.631994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bdffb-48e5-4812-85ee-c51b8b6edf11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:12.634042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bdffb-48e5-4812-85ee-c51b8b6edf11 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:12.702728 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1232/2456] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:38:12 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:38:12.706046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89cb4a-5450-4d8a-a20b-3f167f28ec8a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:12.716654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89cb4a-5450-4d8a-a20b-3f167f28ec8a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:12.720864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:12.783749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228eef2-2d1a-475c-b401-b26476f36394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:12.784350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228eef2-2d1a-475c-b401-b26476f36394 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.784626 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228eef2-2d1a-475c-b401-b26476f36394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.784917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228eef2-2d1a-475c-b401-b26476f36394 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.786478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228eef2-2d1a-475c-b401-b26476f36394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:12.788427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228eef2-2d1a-475c-b401-b26476f36394 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:12.813194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1225/2457] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:38:12 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:38:12.814312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bdffb-48e5-4812-85ee-c51b8b6edf11 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:12.824724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bdffb-48e5-4812-85ee-c51b8b6edf11 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:12.829549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e16db-b0da-4276-b2ff-4f35e2e14bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:12.830151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e16db-b0da-4276-b2ff-4f35e2e14bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.830432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e16db-b0da-4276-b2ff-4f35e2e14bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.830809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e16db-b0da-4276-b2ff-4f35e2e14bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.831446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e16db-b0da-4276-b2ff-4f35e2e14bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:12.833803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e16db-b0da-4276-b2ff-4f35e2e14bd3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:12.846942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1233/2458] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:38:12.848972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228eef2-2d1a-475c-b401-b26476f36394 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:12.859182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228eef2-2d1a-475c-b401-b26476f36394 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:12.864230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12f79-042e-4038-ba30-483d55c57215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:12.864830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12f79-042e-4038-ba30-483d55c57215 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.865129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12f79-042e-4038-ba30-483d55c57215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.865382 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12f79-042e-4038-ba30-483d55c57215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.866028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12f79-042e-4038-ba30-483d55c57215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:12.867684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12f79-042e-4038-ba30-483d55c57215 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:12.880463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1226/2459] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:38:12.884430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e16db-b0da-4276-b2ff-4f35e2e14bd3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:12.895096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e16db-b0da-4276-b2ff-4f35e2e14bd3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:12.900008 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613f398-a1a3-4b37-8280-ddf98be77f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:12.900694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613f398-a1a3-4b37-8280-ddf98be77f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.900977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613f398-a1a3-4b37-8280-ddf98be77f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.901256 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613f398-a1a3-4b37-8280-ddf98be77f1c admin admin] PATH_INFO: `/v3/projects/a5cf6948c3084f82b658188fbefba128/users/814055c34d8741c396a165c172c0b5df/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.919804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613f398-a1a3-4b37-8280-ddf98be77f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5cf6948c3084f82b658188fbefba128, user_id=814055c34d8741c396a165c172c0b5df, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:12.923357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613f398-a1a3-4b37-8280-ddf98be77f1c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:12.948545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1234/2460] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:38:12 2022] PUT /identity/v3/projects/a5cf6948c3084f82b658188fbefba128/users/814055c34d8741c396a165c172c0b5df/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:12.954258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17278dfb-22c4-4381-8236-134a6c2d913a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:12.954774 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17278dfb-22c4-4381-8236-134a6c2d913a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:12.955245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17278dfb-22c4-4381-8236-134a6c2d913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:12.977149 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-17278dfb-22c4-4381-8236-134a6c2d913a None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:12.978560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-17278dfb-22c4-4381-8236-134a6c2d913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:13.049113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1227/2461] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:13.059762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613f398-a1a3-4b37-8280-ddf98be77f1c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:13.062065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7613f398-a1a3-4b37-8280-ddf98be77f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:13.164950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613f398-a1a3-4b37-8280-ddf98be77f1c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:13.168693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837310d5-479a-4f29-a9dc-365da74ff846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:13.169314 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837310d5-479a-4f29-a9dc-365da74ff846 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:13.169592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837310d5-479a-4f29-a9dc-365da74ff846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:13.169865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837310d5-479a-4f29-a9dc-365da74ff846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:13.181799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837310d5-479a-4f29-a9dc-365da74ff846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:13.183177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837310d5-479a-4f29-a9dc-365da74ff846 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:13.195914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:13.211923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1235/2462] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:18.724582 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012cd7c-1cf4-427a-b637-d8e64a04f5a4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:18.725160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012cd7c-1cf4-427a-b637-d8e64a04f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:18.725160 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012cd7c-1cf4-427a-b637-d8e64a04f5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:18.787311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7012cd7c-1cf4-427a-b637-d8e64a04f5a4 None None] MFA Rules not processed for user `814055c34d8741c396a165c172c0b5df`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:18.788885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7012cd7c-1cf4-427a-b637-d8e64a04f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:18.919105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1228/2463] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:18.923548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837310d5-479a-4f29-a9dc-365da74ff846 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:18.935899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837310d5-479a-4f29-a9dc-365da74ff846 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:18.944903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526d65f-4d68-48d5-8ec8-e019a62c4573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:18.946735 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526d65f-4d68-48d5-8ec8-e019a62c4573 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:18.947237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526d65f-4d68-48d5-8ec8-e019a62c4573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:18.947718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526d65f-4d68-48d5-8ec8-e019a62c4573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:18.948595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526d65f-4d68-48d5-8ec8-e019a62c4573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:18.951490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526d65f-4d68-48d5-8ec8-e019a62c4573 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:19.009935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1236/2464] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:38:18 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:38:19.013920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012cd7c-1cf4-427a-b637-d8e64a04f5a4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:19.027783 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012cd7c-1cf4-427a-b637-d8e64a04f5a4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:19.045667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:19.127528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bacd3-9331-47d5-9471-37b55a026216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:19.128174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bacd3-9331-47d5-9471-37b55a026216 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:19.128506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bacd3-9331-47d5-9471-37b55a026216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:19.129231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bacd3-9331-47d5-9471-37b55a026216 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:19.129903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bacd3-9331-47d5-9471-37b55a026216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:19.131916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bacd3-9331-47d5-9471-37b55a026216 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:19.162651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1229/2465] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:38:19 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:38:19.164152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526d65f-4d68-48d5-8ec8-e019a62c4573 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:19.176310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526d65f-4d68-48d5-8ec8-e019a62c4573 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:19.181270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa66c3-da9a-45c0-b7c1-5475a49fc1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:19.181902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa66c3-da9a-45c0-b7c1-5475a49fc1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:19.182178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa66c3-da9a-45c0-b7c1-5475a49fc1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:19.182454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa66c3-da9a-45c0-b7c1-5475a49fc1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:19.183300 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa66c3-da9a-45c0-b7c1-5475a49fc1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:19.184946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa66c3-da9a-45c0-b7c1-5475a49fc1ce admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:19.202492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bacd3-9331-47d5-9471-37b55a026216 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:19.202988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1237/2466] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:38:19.214904 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bacd3-9331-47d5-9471-37b55a026216 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:19.219870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97241e26-6d82-4321-9117-4bebdad41f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:19.220543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97241e26-6d82-4321-9117-4bebdad41f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:19.220826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97241e26-6d82-4321-9117-4bebdad41f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:19.221109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97241e26-6d82-4321-9117-4bebdad41f19 admin admin] PATH_INFO: `/v3/projects/f55f2135126043ca8f903004f5bf521b/users/d2aad09d0e27492083b3acda3d5772ef/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:19.240305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97241e26-6d82-4321-9117-4bebdad41f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55f2135126043ca8f903004f5bf521b, user_id=d2aad09d0e27492083b3acda3d5772ef, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:19.243150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97241e26-6d82-4321-9117-4bebdad41f19 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:19.257745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1230/2467] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:38:19 2022] PUT /identity/v3/projects/f55f2135126043ca8f903004f5bf521b/users/d2aad09d0e27492083b3acda3d5772ef/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:19.261955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa66c3-da9a-45c0-b7c1-5475a49fc1ce admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:19.273355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa66c3-da9a-45c0-b7c1-5475a49fc1ce admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:19.377170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a8436-e41d-4311-86a5-4e8a508cc2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:19.392597 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a8436-e41d-4311-86a5-4e8a508cc2dc admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:19.393050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a8436-e41d-4311-86a5-4e8a508cc2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:19.393333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a8436-e41d-4311-86a5-4e8a508cc2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:19.394056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a8436-e41d-4311-86a5-4e8a508cc2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:19.397088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a8436-e41d-4311-86a5-4e8a508cc2dc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:19.409552 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1238/2468] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:38:19.414088 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97241e26-6d82-4321-9117-4bebdad41f19 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:19.427280 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97241e26-6d82-4321-9117-4bebdad41f19 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:19.432696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043e773-9873-42cd-87d1-2ea31f057293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:19.433485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043e773-9873-42cd-87d1-2ea31f057293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:19.433771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043e773-9873-42cd-87d1-2ea31f057293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:19.434046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043e773-9873-42cd-87d1-2ea31f057293 admin admin] PATH_INFO: `/v3/projects/f55f2135126043ca8f903004f5bf521b/users/d2aad09d0e27492083b3acda3d5772ef/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:19.436028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043e773-9873-42cd-87d1-2ea31f057293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55f2135126043ca8f903004f5bf521b, user_id=d2aad09d0e27492083b3acda3d5772ef, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:19.438951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043e773-9873-42cd-87d1-2ea31f057293 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:19.453733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1231/2469] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:38:19 2022] PUT /identity/v3/projects/f55f2135126043ca8f903004f5bf521b/users/d2aad09d0e27492083b3acda3d5772ef/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:25.921856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c15ad5-feab-4f29-8c8c-47f47ea26cfb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:25.922827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c15ad5-feab-4f29-8c8c-47f47ea26cfb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:25.923258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c15ad5-feab-4f29-8c8c-47f47ea26cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:25.977500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-90c15ad5-feab-4f29-8c8c-47f47ea26cfb None None] MFA Rules not processed for user `d2aad09d0e27492083b3acda3d5772ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:25.978924 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-90c15ad5-feab-4f29-8c8c-47f47ea26cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:26.069814 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1239/2470] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:26.085761 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043e773-9873-42cd-87d1-2ea31f057293 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:26.088213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c043e773-9873-42cd-87d1-2ea31f057293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:26.172282 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043e773-9873-42cd-87d1-2ea31f057293 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:26.179749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea45bca-e911-495c-abd5-89d5f112a9d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:26.180686 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea45bca-e911-495c-abd5-89d5f112a9d3 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:26.180959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea45bca-e911-495c-abd5-89d5f112a9d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:26.181226 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea45bca-e911-495c-abd5-89d5f112a9d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:26.242237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea45bca-e911-495c-abd5-89d5f112a9d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:26.243874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea45bca-e911-495c-abd5-89d5f112a9d3 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:26.254095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1232/2471] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:26.541358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605029-bad9-4e99-a324-9dee8ca4b537 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:26.541646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605029-bad9-4e99-a324-9dee8ca4b537 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:26.541975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605029-bad9-4e99-a324-9dee8ca4b537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:26.570287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f4605029-bad9-4e99-a324-9dee8ca4b537 None None] MFA Rules not processed for user `1479ebe2a7a7426d9ee1dafa37fbd0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:26.571725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f4605029-bad9-4e99-a324-9dee8ca4b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:26.649514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:26.667906 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1240/2472] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:27.603600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b884bfe-6071-469a-82dc-2ee9faa034d2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:27.604219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b884bfe-6071-469a-82dc-2ee9faa034d2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:27.604219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b884bfe-6071-469a-82dc-2ee9faa034d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:27.617549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:27.630605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8b884bfe-6071-469a-82dc-2ee9faa034d2 None None] MFA Rules not processed for user `814055c34d8741c396a165c172c0b5df`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:27.632181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8b884bfe-6071-469a-82dc-2ee9faa034d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:27.640385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1233/2473] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:36.660337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:36.777956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54d231-1cd0-45dd-a86a-faa43f72b5b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:36.778471 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54d231-1cd0-45dd-a86a-faa43f72b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:36.778977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54d231-1cd0-45dd-a86a-faa43f72b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:36.806156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6b54d231-1cd0-45dd-a86a-faa43f72b5b2 None None] MFA Rules not processed for user `09e1a58dc35c49d4b5cccd6d91b9ef47`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:36.806156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6b54d231-1cd0-45dd-a86a-faa43f72b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:36.865050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1241/2474] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:37.627079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:39.729896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b884bfe-6071-469a-82dc-2ee9faa034d2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:39.785821 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b884bfe-6071-469a-82dc-2ee9faa034d2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:39.789402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:39.789999 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:39.790275 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:39.790540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:39.792294 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:39.860318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:39.861890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:39.872063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1234/2475] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:46.857549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=25 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:49.868010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=50 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:53.857140 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a56fbf-74f0-4d01-a3be-ac52f4f1e245 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:53.857651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a56fbf-74f0-4d01-a3be-ac52f4f1e245 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:53.857757 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a56fbf-74f0-4d01-a3be-ac52f4f1e245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:53.877549 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-08a56fbf-74f0-4d01-a3be-ac52f4f1e245 None None] MFA Rules not processed for user `a7c9275aeee8438fa1fde55f207fd730`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:53.879491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-08a56fbf-74f0-4d01-a3be-ac52f4f1e245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:53.944398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1242/2476] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:38:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:59.043293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:59.044773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:59.057855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53fead-8f1f-4370-ab94-c8c32c563a5c service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:59.061533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccd657-bc0c-41f3-8437-daa72a63ba3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:59.062136 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccd657-bc0c-41f3-8437-daa72a63ba3a service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:59.062417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccd657-bc0c-41f3-8437-daa72a63ba3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:59.062704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccd657-bc0c-41f3-8437-daa72a63ba3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:59.074644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccd657-bc0c-41f3-8437-daa72a63ba3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:59.076117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccd657-bc0c-41f3-8437-daa72a63ba3a service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:59.085715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1235/2477] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:03.931599 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=25 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:09.081396 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:18.571307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a56fbf-74f0-4d01-a3be-ac52f4f1e245 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:18.580882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a56fbf-74f0-4d01-a3be-ac52f4f1e245 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:18.584412 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:18.585811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:18.586088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:18.586357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:18.588127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:18.601525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:18.602989 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:18.613616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1243/2478] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:22.139674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccd657-bc0c-41f3-8437-daa72a63ba3a service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:22.152679 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccd657-bc0c-41f3-8437-daa72a63ba3a service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:22.171858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6240c1a-3d20-46bc-8f87-07ca58c93c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:22.172463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6240c1a-3d20-46bc-8f87-07ca58c93c40 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:22.172736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6240c1a-3d20-46bc-8f87-07ca58c93c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:22.173075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6240c1a-3d20-46bc-8f87-07ca58c93c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:22.174859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c6240c1a-3d20-46bc-8f87-07ca58c93c40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:22.196584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6240c1a-3d20-46bc-8f87-07ca58c93c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:22.198363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6240c1a-3d20-46bc-8f87-07ca58c93c40 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:22.213827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1236/2479] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:39:28.608898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:32.206921 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:32.207583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:32.209244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:32.223462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065a9d7-a667-4934-ab0d-9a39d6615016 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:32.229831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb44120-aa98-42e7-a417-04681f02384c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:32.230477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb44120-aa98-42e7-a417-04681f02384c service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:32.230766 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb44120-aa98-42e7-a417-04681f02384c service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:32.231038 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb44120-aa98-42e7-a417-04681f02384c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:32.232783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9bb44120-aa98-42e7-a417-04681f02384c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:32.244365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb44120-aa98-42e7-a417-04681f02384c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:32.245939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb44120-aa98-42e7-a417-04681f02384c service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:32.254950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1244/2480] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:39.271532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6240c1a-3d20-46bc-8f87-07ca58c93c40 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:39.285050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6240c1a-3d20-46bc-8f87-07ca58c93c40 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:39.293447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:39.294061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:39.294340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:39.294641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:39.296624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:39.308463 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:39.310062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:39.319578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1237/2481] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:39.414518 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb44120-aa98-42e7-a417-04681f02384c service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:39.426653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb44120-aa98-42e7-a417-04681f02384c service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:39.430607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:39.431369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:39.431728 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:39.432098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:39.433872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:39.512316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:39.515669 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:39.529976 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1245/2482] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:42.870639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:42.872199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:42.936032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:42.937585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:42.951736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfeb97-e382-4037-87f1-48fab00b5665 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:42.956199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837ee7-294f-4156-b6fd-60e3994c5264 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:42.960116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:42.960753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:42.961031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:42.961208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca085c57-e6b5-43a5-8436-aa605a99476a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:42.961329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] PATH_INFO: `/v3/users/1479ebe2a7a7426d9ee1dafa37fbd0b0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:42.962220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca085c57-e6b5-43a5-8436-aa605a99476a service placement] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:42.962499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca085c57-e6b5-43a5-8436-aa605a99476a service placement] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:42.962608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1479ebe2a7a7426d9ee1dafa37fbd0b0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:42.962812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca085c57-e6b5-43a5-8436-aa605a99476a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:42.964529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ca085c57-e6b5-43a5-8436-aa605a99476a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:42.964649 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:42.976982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca085c57-e6b5-43a5-8436-aa605a99476a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:42.979131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca085c57-e6b5-43a5-8436-aa605a99476a service placement] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:42.989996 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1238/2483] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:43.014873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1479ebe2a7a7426d9ee1dafa37fbd0b0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.028067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1479ebe2a7a7426d9ee1dafa37fbd0b0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.034968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1479ebe2a7a7426d9ee1dafa37fbd0b0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.042358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1479ebe2a7a7426d9ee1dafa37fbd0b0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.042998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-958000a0-ec3e-4e22-baff-49deafbe7dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1479ebe2a7a7426d9ee1dafa37fbd0b0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.048893 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1246/2484] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:39:42 2022] DELETE /identity/v3/users/1479ebe2a7a7426d9ee1dafa37fbd0b0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:39:43.222470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca085c57-e6b5-43a5-8436-aa605a99476a service placement] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:43.233869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca085c57-e6b5-43a5-8436-aa605a99476a service placement] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:43.291886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:43.292473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.292752 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.293019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] PATH_INFO: `/v3/projects/18f60090892b42a297ccdda9a80bd4e5` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.294137 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f60090892b42a297ccdda9a80bd4e5)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:43.296074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:43.340767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f60090892b42a297ccdda9a80bd4e5', 'request_id': 'req-05b4c65d-b668-4535-b7fe-1cc89225206d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.346772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f60090892b42a297ccdda9a80bd4e5', 'request_id': 'req-05b4c65d-b668-4535-b7fe-1cc89225206d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.352207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f60090892b42a297ccdda9a80bd4e5', 'request_id': 'req-05b4c65d-b668-4535-b7fe-1cc89225206d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.364588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] The token cache is being invalidate because project 18f60090892b42a297ccdda9a80bd4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:39:43.364870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.365741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05b4c65d-b668-4535-b7fe-1cc89225206d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:39:43.367261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1239/2485] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:39:43 2022] DELETE /identity/v3/projects/18f60090892b42a297ccdda9a80bd4e5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:39:43.372768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca974e74-ddd5-4246-b274-cda7f5813806 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.373059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca974e74-ddd5-4246-b274-cda7f5813806 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.373339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca974e74-ddd5-4246-b274-cda7f5813806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.393409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ca974e74-ddd5-4246-b274-cda7f5813806 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:43.394609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ca974e74-ddd5-4246-b274-cda7f5813806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:43.446774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:43.460029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1247/2486] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:39:43.467954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66a695-78bd-46d5-a2ab-fbc89ebb905e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.468237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66a695-78bd-46d5-a2ab-fbc89ebb905e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.468513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66a695-78bd-46d5-a2ab-fbc89ebb905e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.483376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:43.489405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4d66a695-78bd-46d5-a2ab-fbc89ebb905e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:43.491607 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4d66a695-78bd-46d5-a2ab-fbc89ebb905e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:43.501177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1240/2487] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:43.505413 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca974e74-ddd5-4246-b274-cda7f5813806 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:43.515484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca974e74-ddd5-4246-b274-cda7f5813806 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:43.520144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b0027-7c7a-4a56-b65d-53767da7bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:43.520751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b0027-7c7a-4a56-b65d-53767da7bb5e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.521031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b0027-7c7a-4a56-b65d-53767da7bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.521304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b0027-7c7a-4a56-b65d-53767da7bb5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.521953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b0027-7c7a-4a56-b65d-53767da7bb5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:39:43.522254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b0027-7c7a-4a56-b65d-53767da7bb5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:43.523903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b0027-7c7a-4a56-b65d-53767da7bb5e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:43.536613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1248/2488] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:39:43.541067 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66a695-78bd-46d5-a2ab-fbc89ebb905e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:43.552277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66a695-78bd-46d5-a2ab-fbc89ebb905e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:43.557826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec93962-6406-49fd-90b3-a62c478b1ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:43.557826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93962-6406-49fd-90b3-a62c478b1ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.557826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93962-6406-49fd-90b3-a62c478b1ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.558185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93962-6406-49fd-90b3-a62c478b1ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.558960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec93962-6406-49fd-90b3-a62c478b1ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:43.560779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec93962-6406-49fd-90b3-a62c478b1ab4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:43.591397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1241/2489] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:39:43 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:39:43.595968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b0027-7c7a-4a56-b65d-53767da7bb5e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:43.606465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b0027-7c7a-4a56-b65d-53767da7bb5e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:43.663780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0719eb-e9d6-42f4-bf03-8e92a76f80c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:43.664382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0719eb-e9d6-42f4-bf03-8e92a76f80c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.664658 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0719eb-e9d6-42f4-bf03-8e92a76f80c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.665011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0719eb-e9d6-42f4-bf03-8e92a76f80c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.666175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0719eb-e9d6-42f4-bf03-8e92a76f80c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:43.673240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0719eb-e9d6-42f4-bf03-8e92a76f80c0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:43.694232 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1249/2490] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:39:43 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:39:43.698605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec93962-6406-49fd-90b3-a62c478b1ab4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:43.708935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec93962-6406-49fd-90b3-a62c478b1ab4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:43.713591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1b208-049c-4c05-b57f-e305daadbdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:43.714185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1b208-049c-4c05-b57f-e305daadbdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.714461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1b208-049c-4c05-b57f-e305daadbdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.714760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1b208-049c-4c05-b57f-e305daadbdb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.715405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1b208-049c-4c05-b57f-e305daadbdb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:43.717006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1b208-049c-4c05-b57f-e305daadbdb7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:43.726564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1242/2491] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:39:43.730505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0719eb-e9d6-42f4-bf03-8e92a76f80c0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:43.740670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0719eb-e9d6-42f4-bf03-8e92a76f80c0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:43.746350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e73e6-f901-468d-b705-33ace20d0c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:43.746968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e73e6-f901-468d-b705-33ace20d0c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.747244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e73e6-f901-468d-b705-33ace20d0c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.747514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e73e6-f901-468d-b705-33ace20d0c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.748148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e73e6-f901-468d-b705-33ace20d0c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:43.749756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e73e6-f901-468d-b705-33ace20d0c62 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:43.761908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1250/2492] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:39:43.766041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1b208-049c-4c05-b57f-e305daadbdb7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:43.776400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1b208-049c-4c05-b57f-e305daadbdb7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:43.781209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd626f0-581e-4863-a52e-1d0adb378c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:43.781907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd626f0-581e-4863-a52e-1d0adb378c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.782199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd626f0-581e-4863-a52e-1d0adb378c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.782479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd626f0-581e-4863-a52e-1d0adb378c17 admin admin] PATH_INFO: `/v3/projects/9cdbc0f0a21740d59fcbfee3b40605bf/users/aee105e9d1ee44f985fdbac834330afd/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.797123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd626f0-581e-4863-a52e-1d0adb378c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdbc0f0a21740d59fcbfee3b40605bf, user_id=aee105e9d1ee44f985fdbac834330afd, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:43.799796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd626f0-581e-4863-a52e-1d0adb378c17 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:43.813016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1243/2493] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:39:43 2022] PUT /identity/v3/projects/9cdbc0f0a21740d59fcbfee3b40605bf/users/aee105e9d1ee44f985fdbac834330afd/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:39:43.818003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5e014-ba07-45c7-9d77-a4cc2fd3891c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.818296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5e014-ba07-45c7-9d77-a4cc2fd3891c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.818572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5e014-ba07-45c7-9d77-a4cc2fd3891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.838139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cea5e014-ba07-45c7-9d77-a4cc2fd3891c None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:43.839383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cea5e014-ba07-45c7-9d77-a4cc2fd3891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:43.898570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1251/2494] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:43.908488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd626f0-581e-4863-a52e-1d0adb378c17 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:43.910194 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7cd626f0-581e-4863-a52e-1d0adb378c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:43.966181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd626f0-581e-4863-a52e-1d0adb378c17 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:43.969888 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e746bb9-7cc7-4c28-9169-d41646633eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:43.970479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e746bb9-7cc7-4c28-9169-d41646633eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:43.970794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e746bb9-7cc7-4c28-9169-d41646633eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:43.971066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e746bb9-7cc7-4c28-9169-d41646633eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:43.980559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e746bb9-7cc7-4c28-9169-d41646633eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:43.981966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e746bb9-7cc7-4c28-9169-d41646633eb4 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:43.991408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1244/2495] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:48.105707 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017bc2-335c-4c1c-9b62-20ff375d9ad1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:48.106580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017bc2-335c-4c1c-9b62-20ff375d9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:48.107770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017bc2-335c-4c1c-9b62-20ff375d9ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:48.145115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-76017bc2-335c-4c1c-9b62-20ff375d9ad1 None None] MFA Rules not processed for user `aee105e9d1ee44f985fdbac834330afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:48.146333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-76017bc2-335c-4c1c-9b62-20ff375d9ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:48.202395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:48.222903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1252/2496] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:39:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:48.239297 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e746bb9-7cc7-4c28-9169-d41646633eb4 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:48.241110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1e746bb9-7cc7-4c28-9169-d41646633eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:48.317284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e746bb9-7cc7-4c28-9169-d41646633eb4 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:48.323025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7130397-8f25-4b56-a00c-259b0c05dcf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:48.323644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130397-8f25-4b56-a00c-259b0c05dcf0 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:48.323922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130397-8f25-4b56-a00c-259b0c05dcf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:48.324197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130397-8f25-4b56-a00c-259b0c05dcf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:48.332572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7130397-8f25-4b56-a00c-259b0c05dcf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:48.334204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7130397-8f25-4b56-a00c-259b0c05dcf0 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:48.344910 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1245/2497] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:39:49.673058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af5d3b-6260-47c5-86bc-30d32ee9b00a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:49.673591 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af5d3b-6260-47c5-86bc-30d32ee9b00a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:49.673753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af5d3b-6260-47c5-86bc-30d32ee9b00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:49.695804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-18af5d3b-6260-47c5-86bc-30d32ee9b00a None None] MFA Rules not processed for user `aee105e9d1ee44f985fdbac834330afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:49.697974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18af5d3b-6260-47c5-86bc-30d32ee9b00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:49.706452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1253/2498] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:39:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:50.060310 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7130397-8f25-4b56-a00c-259b0c05dcf0 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:50.061927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c7130397-8f25-4b56-a00c-259b0c05dcf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:50.074491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7130397-8f25-4b56-a00c-259b0c05dcf0 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:50.078286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:50.078894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:50.079201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:50.079446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:50.081170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:50.092208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:50.093654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:50.106771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1246/2499] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:50.431504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af5d3b-6260-47c5-86bc-30d32ee9b00a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:50.433972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18af5d3b-6260-47c5-86bc-30d32ee9b00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:50.518392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af5d3b-6260-47c5-86bc-30d32ee9b00a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:50.523510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852a439-84d8-4891-90fa-f42564012e2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:50.524312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852a439-84d8-4891-90fa-f42564012e2b service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:50.524661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852a439-84d8-4891-90fa-f42564012e2b service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:50.525094 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852a439-84d8-4891-90fa-f42564012e2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:50.530614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c852a439-84d8-4891-90fa-f42564012e2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:50.542762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852a439-84d8-4891-90fa-f42564012e2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:50.544388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852a439-84d8-4891-90fa-f42564012e2b service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:50.554350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1254/2500] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:52.180215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:52.182564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:52.199009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd582b1-1c54-4f76-85be-754def448b3a service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:52.204548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e1c6d-89d4-4ab9-88a4-51acd17ca78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:52.205490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e1c6d-89d4-4ab9-88a4-51acd17ca78d service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:52.205762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e1c6d-89d4-4ab9-88a4-51acd17ca78d service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:52.206035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e1c6d-89d4-4ab9-88a4-51acd17ca78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:52.208056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ce1e1c6d-89d4-4ab9-88a4-51acd17ca78d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:52.222486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:52.271764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e1c6d-89d4-4ab9-88a4-51acd17ca78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:52.273359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e1c6d-89d4-4ab9-88a4-51acd17ca78d service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:52.285601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1247/2501] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:52.979613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852a439-84d8-4891-90fa-f42564012e2b service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:52.990099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852a439-84d8-4891-90fa-f42564012e2b service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:52.994075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ceec1-7761-44b7-be69-f2db87077d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:52.994749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ceec1-7761-44b7-be69-f2db87077d1f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:52.995196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ceec1-7761-44b7-be69-f2db87077d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:52.995476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ceec1-7761-44b7-be69-f2db87077d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:52.997200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a0ceec1-7761-44b7-be69-f2db87077d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:53.007616 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ceec1-7761-44b7-be69-f2db87077d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:53.009851 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ceec1-7761-44b7-be69-f2db87077d1f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:53.018590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1255/2502] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:02.278603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=20 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:03.014613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=46 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:03.718034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e1c6d-89d4-4ab9-88a4-51acd17ca78d service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:03.731550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e1c6d-89d4-4ab9-88a4-51acd17ca78d service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:03.737436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:03.738064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:03.738369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:03.738667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:03.740551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:03.754952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:03.756662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:03.768893 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1248/2503] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:06.923255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9883a9-b683-4dd8-9e9a-3a5ee40566f6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:06.923771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9883a9-b683-4dd8-9e9a-3a5ee40566f6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:06.924018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9883a9-b683-4dd8-9e9a-3a5ee40566f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:06.947003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5a9883a9-b683-4dd8-9e9a-3a5ee40566f6 None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:06.948106 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a9883a9-b683-4dd8-9e9a-3a5ee40566f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:07.008939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1256/2504] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:40:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:07.052423 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:07.054049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:07.139074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737efb4-a9a6-4ce4-8479-90763649e099 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:07.144907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1cb2-4c7d-457a-8ec7-d7803f8fa860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:07.145576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1cb2-4c7d-457a-8ec7-d7803f8fa860 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:07.145919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1cb2-4c7d-457a-8ec7-d7803f8fa860 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:07.146299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1cb2-4c7d-457a-8ec7-d7803f8fa860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:07.157029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1cb2-4c7d-457a-8ec7-d7803f8fa860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:07.158894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1cb2-4c7d-457a-8ec7-d7803f8fa860 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:07.168966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1249/2505] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:40:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:40:08.356051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9883a9-b683-4dd8-9e9a-3a5ee40566f6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:08.380769 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9883a9-b683-4dd8-9e9a-3a5ee40566f6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:08.394638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0b9df-bfa2-4ce0-af34-1f27e87a5a3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:08.396215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0b9df-bfa2-4ce0-af34-1f27e87a5a3b service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:08.398847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0b9df-bfa2-4ce0-af34-1f27e87a5a3b service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:08.401007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0b9df-bfa2-4ce0-af34-1f27e87a5a3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:08.407872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c2a0b9df-bfa2-4ce0-af34-1f27e87a5a3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:08.425394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0b9df-bfa2-4ce0-af34-1f27e87a5a3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:08.429605 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0b9df-bfa2-4ce0-af34-1f27e87a5a3b service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:08.458722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1257/2506] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:40:08.515959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1cb2-4c7d-457a-8ec7-d7803f8fa860 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:08.558538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1cb2-4c7d-457a-8ec7-d7803f8fa860 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:08.583366 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:08.584262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:08.584615 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:08.585117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:08.591385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:08.620573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:08.637457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:08.665000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1250/2507] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:14.365465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0b9df-bfa2-4ce0-af34-1f27e87a5a3b service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:14.375806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0b9df-bfa2-4ce0-af34-1f27e87a5a3b service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:14.379917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe1c2-229c-4ed7-b291-d7441ec4b36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:14.380623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe1c2-229c-4ed7-b291-d7441ec4b36a service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:14.381121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe1c2-229c-4ed7-b291-d7441ec4b36a service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:14.381486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe1c2-229c-4ed7-b291-d7441ec4b36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:14.384187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-de3fe1c2-229c-4ed7-b291-d7441ec4b36a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:14.398624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fe1c2-229c-4ed7-b291-d7441ec4b36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:14.400860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fe1c2-229c-4ed7-b291-d7441ec4b36a service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:14.413164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1258/2508] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:18.265180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:18.266654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:18.280763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fbee6-24ad-445a-b159-634b514af8df service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:18.285424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:18.286066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:18.286347 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:18.286622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] PATH_INFO: `/v3/users/a7c9275aeee8438fa1fde55f207fd730` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:18.287809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c9275aeee8438fa1fde55f207fd730)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:18.290519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:18.341553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c9275aeee8438fa1fde55f207fd730'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.350785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c9275aeee8438fa1fde55f207fd730'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.351401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c9275aeee8438fa1fde55f207fd730'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.365880 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c9275aeee8438fa1fde55f207fd730'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.373940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d16b2c1b-af43-46a1-9323-7f110a12a9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c9275aeee8438fa1fde55f207fd730'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.380343 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1251/2509] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:18 2022] DELETE /identity/v3/users/a7c9275aeee8438fa1fde55f207fd730 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:18.564566 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe1c2-229c-4ed7-b291-d7441ec4b36a service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:18.575499 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe1c2-229c-4ed7-b291-d7441ec4b36a service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:18.640363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:18.641014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:18.641295 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:18.641572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] PATH_INFO: `/v3/projects/09cf6cd7e1704b069d00447b246133fd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:18.642754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09cf6cd7e1704b069d00447b246133fd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:18.644716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:18.693609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09cf6cd7e1704b069d00447b246133fd', 'request_id': 'req-76b69bc7-3f96-4860-b170-941bb8cebe69'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.703228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09cf6cd7e1704b069d00447b246133fd', 'request_id': 'req-76b69bc7-3f96-4860-b170-941bb8cebe69'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.710032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09cf6cd7e1704b069d00447b246133fd', 'request_id': 'req-76b69bc7-3f96-4860-b170-941bb8cebe69'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.722450 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] The token cache is being invalidate because project 09cf6cd7e1704b069d00447b246133fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:18.722836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.723503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-76b69bc7-3f96-4860-b170-941bb8cebe69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:18.725018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1259/2510] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:18 2022] DELETE /identity/v3/projects/09cf6cd7e1704b069d00447b246133fd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:18.730498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22291a-cd4b-460e-8d4d-e7ad0deac9be None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:18.730961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22291a-cd4b-460e-8d4d-e7ad0deac9be None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:18.731398 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22291a-cd4b-460e-8d4d-e7ad0deac9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:18.753171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4d22291a-cd4b-460e-8d4d-e7ad0deac9be None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:18.754402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4d22291a-cd4b-460e-8d4d-e7ad0deac9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:18.784382 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:18.815213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1252/2511] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:40:18.823779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb278c-7ef5-41d5-8cfa-739fceff1f9f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:18.824062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb278c-7ef5-41d5-8cfa-739fceff1f9f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:18.824366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb278c-7ef5-41d5-8cfa-739fceff1f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:18.844044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-67bb278c-7ef5-41d5-8cfa-739fceff1f9f None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:18.845530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-67bb278c-7ef5-41d5-8cfa-739fceff1f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:18.853558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1260/2512] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:18.857784 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22291a-cd4b-460e-8d4d-e7ad0deac9be None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:18.868290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22291a-cd4b-460e-8d4d-e7ad0deac9be None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:18.873038 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c595c2-e5e3-42cf-8e98-bc257c6cfd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:18.873631 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c595c2-e5e3-42cf-8e98-bc257c6cfd27 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:18.873911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c595c2-e5e3-42cf-8e98-bc257c6cfd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:18.874212 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c595c2-e5e3-42cf-8e98-bc257c6cfd27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:18.874889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c595c2-e5e3-42cf-8e98-bc257c6cfd27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:40:18.875191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c595c2-e5e3-42cf-8e98-bc257c6cfd27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:18.876807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c595c2-e5e3-42cf-8e98-bc257c6cfd27 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:18.888717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1253/2513] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:40:18.893176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb278c-7ef5-41d5-8cfa-739fceff1f9f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:18.897634 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:18.904089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb278c-7ef5-41d5-8cfa-739fceff1f9f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:18.909750 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d293f3f-1899-4c76-a3b7-cc3dd27de8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:18.910383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d293f3f-1899-4c76-a3b7-cc3dd27de8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:18.910717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d293f3f-1899-4c76-a3b7-cc3dd27de8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:18.910987 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d293f3f-1899-4c76-a3b7-cc3dd27de8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:18.911646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d293f3f-1899-4c76-a3b7-cc3dd27de8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:18.913577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d293f3f-1899-4c76-a3b7-cc3dd27de8a3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:18.940637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1261/2514] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:40:18 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:18.944869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c595c2-e5e3-42cf-8e98-bc257c6cfd27 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:18.956215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c595c2-e5e3-42cf-8e98-bc257c6cfd27 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:19.011989 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcccb6-fa00-4d3b-b445-6815bf59cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:19.012592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcccb6-fa00-4d3b-b445-6815bf59cb3b admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:19.012903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcccb6-fa00-4d3b-b445-6815bf59cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:19.013178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcccb6-fa00-4d3b-b445-6815bf59cb3b admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:19.013807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcccb6-fa00-4d3b-b445-6815bf59cb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:19.015771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcccb6-fa00-4d3b-b445-6815bf59cb3b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:19.037680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1254/2515] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:40:18 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:19.042017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d293f3f-1899-4c76-a3b7-cc3dd27de8a3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:19.052046 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d293f3f-1899-4c76-a3b7-cc3dd27de8a3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:19.057209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d03e3e-5366-4355-ad6d-b587780b51b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:19.057795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d03e3e-5366-4355-ad6d-b587780b51b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:19.058070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d03e3e-5366-4355-ad6d-b587780b51b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:19.058337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d03e3e-5366-4355-ad6d-b587780b51b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:19.059015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d03e3e-5366-4355-ad6d-b587780b51b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:19.060604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d03e3e-5366-4355-ad6d-b587780b51b0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:19.070258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1262/2516] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:40:19.080013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcccb6-fa00-4d3b-b445-6815bf59cb3b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:19.090153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcccb6-fa00-4d3b-b445-6815bf59cb3b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:19.094830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b4cb4-d50d-44c3-91f4-f0e5e08aca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:19.095430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b4cb4-d50d-44c3-91f4-f0e5e08aca88 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:19.095709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b4cb4-d50d-44c3-91f4-f0e5e08aca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:19.095979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b4cb4-d50d-44c3-91f4-f0e5e08aca88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:19.096621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b4cb4-d50d-44c3-91f4-f0e5e08aca88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:19.098217 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b4cb4-d50d-44c3-91f4-f0e5e08aca88 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:19.110165 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1255/2517] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:40:19.114363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d03e3e-5366-4355-ad6d-b587780b51b0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:19.125409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d03e3e-5366-4355-ad6d-b587780b51b0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:19.130089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6c79-436a-4c27-ab28-e93186217a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:19.130767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6c79-436a-4c27-ab28-e93186217a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:19.131050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6c79-436a-4c27-ab28-e93186217a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:19.131326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6c79-436a-4c27-ab28-e93186217a97 admin admin] PATH_INFO: `/v3/projects/0141cbe94984454aaf6667f722da2f9c/users/1081e4799e114b16b77504ed383791c1/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:19.145794 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6c79-436a-4c27-ab28-e93186217a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0141cbe94984454aaf6667f722da2f9c, user_id=1081e4799e114b16b77504ed383791c1, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:19.148505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6c79-436a-4c27-ab28-e93186217a97 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:19.160862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1263/2518] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:19 2022] PUT /identity/v3/projects/0141cbe94984454aaf6667f722da2f9c/users/1081e4799e114b16b77504ed383791c1/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:19.171420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126ab8-f759-44d8-bb11-1989505e1d55 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:19.171704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126ab8-f759-44d8-bb11-1989505e1d55 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:19.171978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126ab8-f759-44d8-bb11-1989505e1d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:19.199537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e8126ab8-f759-44d8-bb11-1989505e1d55 None None] MFA Rules not processed for user `1081e4799e114b16b77504ed383791c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:19.201222 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e8126ab8-f759-44d8-bb11-1989505e1d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:19.264533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1256/2519] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:19.275625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6c79-436a-4c27-ab28-e93186217a97 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:19.277399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-58da6c79-436a-4c27-ab28-e93186217a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:19.350574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6c79-436a-4c27-ab28-e93186217a97 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:19.356979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037099-6057-4596-98e6-67b9f2d8f68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:19.357580 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037099-6057-4596-98e6-67b9f2d8f68f service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:19.357863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037099-6057-4596-98e6-67b9f2d8f68f service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:19.358131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037099-6057-4596-98e6-67b9f2d8f68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:19.365747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037099-6057-4596-98e6-67b9f2d8f68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:19.367569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037099-6057-4596-98e6-67b9f2d8f68f service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:19.377049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1264/2520] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:21.908046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527af9a-877d-4b2b-9a8d-4b2efb02221f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:21.908588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527af9a-877d-4b2b-9a8d-4b2efb02221f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:21.908588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527af9a-877d-4b2b-9a8d-4b2efb02221f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:21.909928 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1257/2521] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:40:21.916749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfde56-df24-4358-9f68-6d87144e7186 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:21.917318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfde56-df24-4358-9f68-6d87144e7186 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:21.917318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfde56-df24-4358-9f68-6d87144e7186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:21.940238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-30dfde56-df24-4358-9f68-6d87144e7186 None None] MFA Rules not processed for user `76462c2e1ec447acbd2aba9e77ae00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:21.941465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-30dfde56-df24-4358-9f68-6d87144e7186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:21.951673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1265/2522] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:40:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:21.962818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527af9a-877d-4b2b-9a8d-4b2efb02221f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:21.964730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1527af9a-877d-4b2b-9a8d-4b2efb02221f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:22.000547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:22.028274 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527af9a-877d-4b2b-9a8d-4b2efb02221f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:22.032011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9c5e4-a6ba-403a-8071-5a1a2d7d66e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb50ee2f9ccd4a258f3396074db66e74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:22.032620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c5e4-a6ba-403a-8071-5a1a2d7d66e6 service glance] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.032896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c5e4-a6ba-403a-8071-5a1a2d7d66e6 service glance] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.033166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c5e4-a6ba-403a-8071-5a1a2d7d66e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.044213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c5e4-a6ba-403a-8071-5a1a2d7d66e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:22.045638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c5e4-a6ba-403a-8071-5a1a2d7d66e6 service glance] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:22.057721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1258/2523] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:40:22.085944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfde56-df24-4358-9f68-6d87144e7186 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:22.131794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c569b-33c0-4edf-93b4-c604861d5196 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.132006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c569b-33c0-4edf-93b4-c604861d5196 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.132283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c569b-33c0-4edf-93b4-c604861d5196 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.133623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1259/2524] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 31 11:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:40:22.138998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25579c7-532c-4882-9ac1-139caec7564e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.139283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25579c7-532c-4882-9ac1-139caec7564e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.139559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25579c7-532c-4882-9ac1-139caec7564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.159451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c25579c7-532c-4882-9ac1-139caec7564e None None] MFA Rules not processed for user `e0f654bfe8364490a322b88433dd8fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:22.160716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c25579c7-532c-4882-9ac1-139caec7564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:22.161940 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfde56-df24-4358-9f68-6d87144e7186 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:22.167171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:22.167801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.168120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.168385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] PATH_INFO: `/v3/users/1081e4799e114b16b77504ed383791c1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.169526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1081e4799e114b16b77504ed383791c1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:22.171485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:22.199907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:22.217612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1260/2525] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 31 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:40:22.222672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1081e4799e114b16b77504ed383791c1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.230181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25579c7-532c-4882-9ac1-139caec7564e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:22.231588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c25579c7-532c-4882-9ac1-139caec7564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:22.235031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1081e4799e114b16b77504ed383791c1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.241938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25579c7-532c-4882-9ac1-139caec7564e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:22.243493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1081e4799e114b16b77504ed383791c1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.245761 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9d2ec-bc57-4f31-87f6-89679a91d14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:22.246337 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9d2ec-bc57-4f31-87f6-89679a91d14f service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.246611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9d2ec-bc57-4f31-87f6-89679a91d14f service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.246907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9d2ec-bc57-4f31-87f6-89679a91d14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.251026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1081e4799e114b16b77504ed383791c1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.251648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39fb0657-7751-4f44-92da-509fa9e628a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1081e4799e114b16b77504ed383791c1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.254491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9d2ec-bc57-4f31-87f6-89679a91d14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:22.255962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9d2ec-bc57-4f31-87f6-89679a91d14f service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:22.257759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1266/2526] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:22 2022] DELETE /identity/v3/users/1081e4799e114b16b77504ed383791c1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:22.262984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59f59-e27c-43ca-a376-462cc619d59b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.263275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59f59-e27c-43ca-a376-462cc619d59b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.263556 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59f59-e27c-43ca-a376-462cc619d59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.264399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1261/2527] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:40:22.283303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-92f59f59-e27c-43ca-a376-462cc619d59b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:22.284524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-92f59f59-e27c-43ca-a376-462cc619d59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:22.348269 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1267/2528] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:40:22.358080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9d2ec-bc57-4f31-87f6-89679a91d14f service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:22.367052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9d2ec-bc57-4f31-87f6-89679a91d14f service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:22.418444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6a5b2-2a1b-4d91-b3e4-ec641c1a4834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:22.419090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a5b2-2a1b-4d91-b3e4-ec641c1a4834 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.419394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a5b2-2a1b-4d91-b3e4-ec641c1a4834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.419693 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a5b2-2a1b-4d91-b3e4-ec641c1a4834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.428813 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6a5b2-2a1b-4d91-b3e4-ec641c1a4834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:22.430225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6a5b2-2a1b-4d91-b3e4-ec641c1a4834 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:22.440719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1262/2529] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:22.722887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f59f59-e27c-43ca-a376-462cc619d59b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:22.724420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-92f59f59-e27c-43ca-a376-462cc619d59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:22.745764 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f59f59-e27c-43ca-a376-462cc619d59b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:22.751040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:22.751727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.752006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.752289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] PATH_INFO: `/v3/projects/0141cbe94984454aaf6667f722da2f9c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.753509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0141cbe94984454aaf6667f722da2f9c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:22.755513 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:22.808026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0141cbe94984454aaf6667f722da2f9c', 'request_id': 'req-5bcff485-cbdc-48cc-aec8-70184112434b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.814972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0141cbe94984454aaf6667f722da2f9c', 'request_id': 'req-5bcff485-cbdc-48cc-aec8-70184112434b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.821390 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0141cbe94984454aaf6667f722da2f9c', 'request_id': 'req-5bcff485-cbdc-48cc-aec8-70184112434b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.833485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] The token cache is being invalidate because project 0141cbe94984454aaf6667f722da2f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:22.833762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.834507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bcff485-cbdc-48cc-aec8-70184112434b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:22.836029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1268/2530] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:22 2022] DELETE /identity/v3/projects/0141cbe94984454aaf6667f722da2f9c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:40:22.842173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4138c-8619-48f7-8484-4916581085d0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.842713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4138c-8619-48f7-8484-4916581085d0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.843037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4138c-8619-48f7-8484-4916581085d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.862916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5fe4138c-8619-48f7-8484-4916581085d0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:22.864219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5fe4138c-8619-48f7-8484-4916581085d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:22.930197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1263/2531] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:40:22.938933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ca3a-597a-4f63-ae55-0a8e597b20f7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.939464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ca3a-597a-4f63-ae55-0a8e597b20f7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.939464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ca3a-597a-4f63-ae55-0a8e597b20f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.960618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3c24ca3a-597a-4f63-ae55-0a8e597b20f7 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:22.961809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3c24ca3a-597a-4f63-ae55-0a8e597b20f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:22.970498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1269/2532] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:40:22.974706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4138c-8619-48f7-8484-4916581085d0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:22.985004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4138c-8619-48f7-8484-4916581085d0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:22.989690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f60d34-aa5e-41a3-927f-c9f506d7beee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:22.990373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f60d34-aa5e-41a3-927f-c9f506d7beee admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:22.990651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f60d34-aa5e-41a3-927f-c9f506d7beee admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:22.990968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f60d34-aa5e-41a3-927f-c9f506d7beee admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:22.991859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f60d34-aa5e-41a3-927f-c9f506d7beee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:40:22.992161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f60d34-aa5e-41a3-927f-c9f506d7beee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:22.993861 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f60d34-aa5e-41a3-927f-c9f506d7beee admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.002719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:23.006967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1264/2533] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:40:23.011653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ca3a-597a-4f63-ae55-0a8e597b20f7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.021248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ca3a-597a-4f63-ae55-0a8e597b20f7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.026708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc574c7-be23-4cac-916e-72f1a99ddcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.027328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc574c7-be23-4cac-916e-72f1a99ddcbe admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.027611 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc574c7-be23-4cac-916e-72f1a99ddcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.027885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc574c7-be23-4cac-916e-72f1a99ddcbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.028525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc574c7-be23-4cac-916e-72f1a99ddcbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.030644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc574c7-be23-4cac-916e-72f1a99ddcbe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.051787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:23.076441 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1270/2534] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:40:23 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:40:23.080602 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f60d34-aa5e-41a3-927f-c9f506d7beee admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.092206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f60d34-aa5e-41a3-927f-c9f506d7beee admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.159795 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f8c1-254d-43f9-a043-bebae3261d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.160594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f8c1-254d-43f9-a043-bebae3261d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.160869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f8c1-254d-43f9-a043-bebae3261d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.161134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f8c1-254d-43f9-a043-bebae3261d93 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.161786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741f8c1-254d-43f9-a043-bebae3261d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.163779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741f8c1-254d-43f9-a043-bebae3261d93 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.201793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1265/2535] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:40:23 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:40:23.202997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc574c7-be23-4cac-916e-72f1a99ddcbe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.215101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc574c7-be23-4cac-916e-72f1a99ddcbe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.220004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635188b-5b1e-4bae-a8c9-9066be00ceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.220736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635188b-5b1e-4bae-a8c9-9066be00ceb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.221104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635188b-5b1e-4bae-a8c9-9066be00ceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.221434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635188b-5b1e-4bae-a8c9-9066be00ceb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.222159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635188b-5b1e-4bae-a8c9-9066be00ceb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.223939 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635188b-5b1e-4bae-a8c9-9066be00ceb8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.235141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1271/2536] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:40:23.239335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f8c1-254d-43f9-a043-bebae3261d93 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.250369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f8c1-254d-43f9-a043-bebae3261d93 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.255192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82eeee-1ecf-4fa7-b969-7662d694fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.255790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82eeee-1ecf-4fa7-b969-7662d694fe34 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.256069 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82eeee-1ecf-4fa7-b969-7662d694fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.256339 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82eeee-1ecf-4fa7-b969-7662d694fe34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.256992 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82eeee-1ecf-4fa7-b969-7662d694fe34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.258559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82eeee-1ecf-4fa7-b969-7662d694fe34 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.270086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1266/2537] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:40:23.274366 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635188b-5b1e-4bae-a8c9-9066be00ceb8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.285057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635188b-5b1e-4bae-a8c9-9066be00ceb8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.289733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c8aa3-a71e-4179-9d49-4a4d33dca25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.290385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c8aa3-a71e-4179-9d49-4a4d33dca25f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.290815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c8aa3-a71e-4179-9d49-4a4d33dca25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.291096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c8aa3-a71e-4179-9d49-4a4d33dca25f admin admin] PATH_INFO: `/v3/projects/da09a852982248e58378568a1d2ba55a/users/99698a42ee3947bbb0ecec40afb1e526/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.307696 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c8aa3-a71e-4179-9d49-4a4d33dca25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da09a852982248e58378568a1d2ba55a, user_id=99698a42ee3947bbb0ecec40afb1e526, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.310371 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c8aa3-a71e-4179-9d49-4a4d33dca25f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.326176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1272/2538] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:23 2022] PUT /identity/v3/projects/da09a852982248e58378568a1d2ba55a/users/99698a42ee3947bbb0ecec40afb1e526/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:40:23.336732 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e2932-c6c5-427a-bd43-a988fba68ae0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.337019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e2932-c6c5-427a-bd43-a988fba68ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.337298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e2932-c6c5-427a-bd43-a988fba68ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.372651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-323e2932-c6c5-427a-bd43-a988fba68ae0 None None] MFA Rules not processed for user `99698a42ee3947bbb0ecec40afb1e526`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:23.374359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-323e2932-c6c5-427a-bd43-a988fba68ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:23.440733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1267/2539] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:23.445059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c8aa3-a71e-4179-9d49-4a4d33dca25f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.524136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c8aa3-a71e-4179-9d49-4a4d33dca25f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.529127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c1348-72a0-44a4-9ead-3f92fb75b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.529740 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c1348-72a0-44a4-9ead-3f92fb75b3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.530392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c1348-72a0-44a4-9ead-3f92fb75b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.530860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c1348-72a0-44a4-9ead-3f92fb75b3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.531724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c1348-72a0-44a4-9ead-3f92fb75b3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.533831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c1348-72a0-44a4-9ead-3f92fb75b3f4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.577672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1273/2540] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:40:23 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:23.578838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e2932-c6c5-427a-bd43-a988fba68ae0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.590558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e2932-c6c5-427a-bd43-a988fba68ae0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.655960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb980-621d-4ae2-8c64-f18e0dc50edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.656833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb980-621d-4ae2-8c64-f18e0dc50edd admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.657265 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb980-621d-4ae2-8c64-f18e0dc50edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.657701 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb980-621d-4ae2-8c64-f18e0dc50edd admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.658440 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbb980-621d-4ae2-8c64-f18e0dc50edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.661636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbb980-621d-4ae2-8c64-f18e0dc50edd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.684479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:23.698109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1268/2541] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:40:23 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:40:23.699074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c1348-72a0-44a4-9ead-3f92fb75b3f4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.713085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c1348-72a0-44a4-9ead-3f92fb75b3f4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.717934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99f3b7-51a3-4d02-b486-18adeaf03d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.718574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99f3b7-51a3-4d02-b486-18adeaf03d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.718930 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99f3b7-51a3-4d02-b486-18adeaf03d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.719308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99f3b7-51a3-4d02-b486-18adeaf03d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.719864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99f3b7-51a3-4d02-b486-18adeaf03d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.721489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99f3b7-51a3-4d02-b486-18adeaf03d9c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.737428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1274/2542] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:40:23.741865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb980-621d-4ae2-8c64-f18e0dc50edd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.759035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb980-621d-4ae2-8c64-f18e0dc50edd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.765766 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987060b-9471-43de-8b8a-15e0b0b4ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.766445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987060b-9471-43de-8b8a-15e0b0b4ae66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.766765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987060b-9471-43de-8b8a-15e0b0b4ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.767045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987060b-9471-43de-8b8a-15e0b0b4ae66 admin admin] PATH_INFO: `/v3/projects/dd58e1a706a3490c86b2942e3da4e43f/users/c71db52000864ed185dbd7ac50445486/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.783450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987060b-9471-43de-8b8a-15e0b0b4ae66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd58e1a706a3490c86b2942e3da4e43f, user_id=c71db52000864ed185dbd7ac50445486, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.786157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987060b-9471-43de-8b8a-15e0b0b4ae66 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.800478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1269/2543] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:23 2022] PUT /identity/v3/projects/dd58e1a706a3490c86b2942e3da4e43f/users/c71db52000864ed185dbd7ac50445486/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:23.804387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99f3b7-51a3-4d02-b486-18adeaf03d9c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.814417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99f3b7-51a3-4d02-b486-18adeaf03d9c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.872730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad60ae2-669b-4d1e-8726-57750b45b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.873344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad60ae2-669b-4d1e-8726-57750b45b8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.873625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad60ae2-669b-4d1e-8726-57750b45b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.873898 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad60ae2-669b-4d1e-8726-57750b45b8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.874540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad60ae2-669b-4d1e-8726-57750b45b8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.876177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad60ae2-669b-4d1e-8726-57750b45b8aa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.886878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1275/2544] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:40:23.891055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987060b-9471-43de-8b8a-15e0b0b4ae66 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:23.903867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987060b-9471-43de-8b8a-15e0b0b4ae66 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:23.908825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1255a8-3c07-4c29-81a4-00a89b70ee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:23.909482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1255a8-3c07-4c29-81a4-00a89b70ee1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.909760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1255a8-3c07-4c29-81a4-00a89b70ee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.910029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1255a8-3c07-4c29-81a4-00a89b70ee1c admin admin] PATH_INFO: `/v3/projects/dd58e1a706a3490c86b2942e3da4e43f/users/c71db52000864ed185dbd7ac50445486/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.911986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1255a8-3c07-4c29-81a4-00a89b70ee1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd58e1a706a3490c86b2942e3da4e43f, user_id=c71db52000864ed185dbd7ac50445486, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:23.914634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1255a8-3c07-4c29-81a4-00a89b70ee1c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:23.926368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1270/2545] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:23 2022] PUT /identity/v3/projects/dd58e1a706a3490c86b2942e3da4e43f/users/c71db52000864ed185dbd7ac50445486/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:23.936958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a500e5-8026-46ab-8e75-c68faa9179f2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:23.937242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a500e5-8026-46ab-8e75-c68faa9179f2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:23.937510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a500e5-8026-46ab-8e75-c68faa9179f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:23.968330 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-84a500e5-8026-46ab-8e75-c68faa9179f2 None None] MFA Rules not processed for user `c71db52000864ed185dbd7ac50445486`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:23.969550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-84a500e5-8026-46ab-8e75-c68faa9179f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:23.992126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:24.042398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1276/2546] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:24.055158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1255a8-3c07-4c29-81a4-00a89b70ee1c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:24.057670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bb1255a8-3c07-4c29-81a4-00a89b70ee1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:24.122438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1255a8-3c07-4c29-81a4-00a89b70ee1c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:24.126345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5de58-2aca-40cb-9d6c-3d84c202ea45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:24.126986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5de58-2aca-40cb-9d6c-3d84c202ea45 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:24.127268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5de58-2aca-40cb-9d6c-3d84c202ea45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:24.127670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5de58-2aca-40cb-9d6c-3d84c202ea45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:24.137598 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5de58-2aca-40cb-9d6c-3d84c202ea45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:24.139086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5de58-2aca-40cb-9d6c-3d84c202ea45 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:24.148762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1271/2547] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:24.157938 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a88a-304b-455b-903c-539928e043d2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:24.158233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a88a-304b-455b-903c-539928e043d2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:24.158515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a88a-304b-455b-903c-539928e043d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:24.178924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5de58-2aca-40cb-9d6c-3d84c202ea45 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:24.182231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b410a88a-304b-455b-903c-539928e043d2 None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:24.183818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b410a88a-304b-455b-903c-539928e043d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:24.248983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5de58-2aca-40cb-9d6c-3d84c202ea45 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:24.252872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1277/2548] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 31 11:40:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:24.254416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:24.255178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:24.255460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:24.255733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] PATH_INFO: `/v3/users/99698a42ee3947bbb0ecec40afb1e526` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:24.256894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99698a42ee3947bbb0ecec40afb1e526)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:24.258881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:24.266909 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410a88a-304b-455b-903c-539928e043d2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:24.268310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b410a88a-304b-455b-903c-539928e043d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:24.307709 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99698a42ee3947bbb0ecec40afb1e526'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:24.315240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99698a42ee3947bbb0ecec40afb1e526'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:24.315908 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99698a42ee3947bbb0ecec40afb1e526'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:24.324492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:24.330209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99698a42ee3947bbb0ecec40afb1e526'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:24.339512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a13f9cfb-3460-4686-9c71-f78232267cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99698a42ee3947bbb0ecec40afb1e526'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:24.345374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1272/2549] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:24 2022] DELETE /identity/v3/users/99698a42ee3947bbb0ecec40afb1e526 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:40:24.350028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10323495-8958-452b-85d0-44a51b7b8a9b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:24.350329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10323495-8958-452b-85d0-44a51b7b8a9b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:24.350725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10323495-8958-452b-85d0-44a51b7b8a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:24.353811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410a88a-304b-455b-903c-539928e043d2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:24.372662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-10323495-8958-452b-85d0-44a51b7b8a9b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:24.373937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-10323495-8958-452b-85d0-44a51b7b8a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:24.419683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:24.420200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:24.420481 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:24.420761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:24.422632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:24.429391 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:24.440346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1273/2550] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:40:24.450537 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10323495-8958-452b-85d0-44a51b7b8a9b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:24.452561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-10323495-8958-452b-85d0-44a51b7b8a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:24.493608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:24.496335 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:24.505218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1278/2551] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:40:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 11:40:24.520625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10323495-8958-452b-85d0-44a51b7b8a9b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:24.524411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412b9b8-3c17-46c6-bf7b-f12a6697e672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:24.525272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412b9b8-3c17-46c6-bf7b-f12a6697e672 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:24.525551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412b9b8-3c17-46c6-bf7b-f12a6697e672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:24.525712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412b9b8-3c17-46c6-bf7b-f12a6697e672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:24.537141 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412b9b8-3c17-46c6-bf7b-f12a6697e672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:24.538587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412b9b8-3c17-46c6-bf7b-f12a6697e672 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:24.550708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1274/2552] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:24.961731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:24.964716 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:24.986517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936368cd-c54f-4b90-9342-b30c64131e3b service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:24.996109 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:24.996773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:24.997052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:24.997331 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] PATH_INFO: `/v3/projects/da09a852982248e58378568a1d2ba55a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:24.998562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=da09a852982248e58378568a1d2ba55a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:25.008733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:25.075351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da09a852982248e58378568a1d2ba55a', 'request_id': 'req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.084960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da09a852982248e58378568a1d2ba55a', 'request_id': 'req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.092100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da09a852982248e58378568a1d2ba55a', 'request_id': 'req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.104030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] The token cache is being invalidate because project da09a852982248e58378568a1d2ba55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:25.104247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.105083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.107348 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1279/2553] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:24 2022] DELETE /identity/v3/projects/da09a852982248e58378568a1d2ba55a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:40:25.111636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412b9b8-3c17-46c6-bf7b-f12a6697e672 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:25.122504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412b9b8-3c17-46c6-bf7b-f12a6697e672 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:25.185596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:25.186236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:25.186516 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:25.186832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] PATH_INFO: `/v3/users/c71db52000864ed185dbd7ac50445486` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:25.187983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71db52000864ed185dbd7ac50445486)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:25.189923 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:25.225122 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:25.247281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71db52000864ed185dbd7ac50445486'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.255416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71db52000864ed185dbd7ac50445486'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.256034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71db52000864ed185dbd7ac50445486'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.272961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71db52000864ed185dbd7ac50445486'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.283459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0761f7ea-5aa8-42b2-9437-9056fe5bd1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71db52000864ed185dbd7ac50445486'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.289838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1275/2554] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:25 2022] DELETE /identity/v3/users/c71db52000864ed185dbd7ac50445486 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:25.626981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:25.628438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:25.652776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa3446-f928-46df-a1cb-5b0b9659ef4f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:25.746618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:25.747731 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:25.748085 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:25.748573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] PATH_INFO: `/v3/projects/dd58e1a706a3490c86b2942e3da4e43f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:25.749821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd58e1a706a3490c86b2942e3da4e43f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:25.752174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:25.807331 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:25.830041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd58e1a706a3490c86b2942e3da4e43f', 'request_id': 'req-0a67031c-a4c7-406e-be0f-b4c36acae401'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.840419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd58e1a706a3490c86b2942e3da4e43f', 'request_id': 'req-0a67031c-a4c7-406e-be0f-b4c36acae401'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.848467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd58e1a706a3490c86b2942e3da4e43f', 'request_id': 'req-0a67031c-a4c7-406e-be0f-b4c36acae401'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.871051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] The token cache is being invalidate because project dd58e1a706a3490c86b2942e3da4e43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:25.871689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.872659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a67031c-a4c7-406e-be0f-b4c36acae401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:25.879337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1280/2555] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:25 2022] DELETE /identity/v3/projects/dd58e1a706a3490c86b2942e3da4e43f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:25.880854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73d22-2c17-4098-9ec3-6ed9bd331eef None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:25.881172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73d22-2c17-4098-9ec3-6ed9bd331eef None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:25.881428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73d22-2c17-4098-9ec3-6ed9bd331eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:25.901547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-eab73d22-2c17-4098-9ec3-6ed9bd331eef None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:25.902793 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-eab73d22-2c17-4098-9ec3-6ed9bd331eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:25.990429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1276/2556] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:25.999515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8dad8-da67-47e4-a1e8-f58bc61605ec None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:25.999515 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8dad8-da67-47e4-a1e8-f58bc61605ec None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.000155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8dad8-da67-47e4-a1e8-f58bc61605ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.020397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-efb8dad8-da67-47e4-a1e8-f58bc61605ec None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:26.021749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-efb8dad8-da67-47e4-a1e8-f58bc61605ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:26.030290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1281/2557] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:26.034765 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73d22-2c17-4098-9ec3-6ed9bd331eef None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.045960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73d22-2c17-4098-9ec3-6ed9bd331eef None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.052785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc0053-1246-487b-93f6-12d0aaafe2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.053482 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc0053-1246-487b-93f6-12d0aaafe2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.053832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc0053-1246-487b-93f6-12d0aaafe2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.054170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc0053-1246-487b-93f6-12d0aaafe2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.054888 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc0053-1246-487b-93f6-12d0aaafe2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:40:26.055329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc0053-1246-487b-93f6-12d0aaafe2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.058266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc0053-1246-487b-93f6-12d0aaafe2b1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.070748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1277/2558] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:40:26.075141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8dad8-da67-47e4-a1e8-f58bc61605ec None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.084780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8dad8-da67-47e4-a1e8-f58bc61605ec None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.089869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ad6b-1b6b-4dc0-9df7-c72eaae64d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.090614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ad6b-1b6b-4dc0-9df7-c72eaae64d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.090952 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ad6b-1b6b-4dc0-9df7-c72eaae64d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.091237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ad6b-1b6b-4dc0-9df7-c72eaae64d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.091910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294ad6b-1b6b-4dc0-9df7-c72eaae64d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.093910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294ad6b-1b6b-4dc0-9df7-c72eaae64d2d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.126860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1282/2559] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:40:26 2022] POST /identity/v3/projects => generated 407 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:26.131344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc0053-1246-487b-93f6-12d0aaafe2b1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.142948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc0053-1246-487b-93f6-12d0aaafe2b1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.205062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576f1b-7b43-4366-b0f4-48fcce130c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.205656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576f1b-7b43-4366-b0f4-48fcce130c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.205935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576f1b-7b43-4366-b0f4-48fcce130c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.206205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576f1b-7b43-4366-b0f4-48fcce130c06 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.206870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c576f1b-7b43-4366-b0f4-48fcce130c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.208794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c576f1b-7b43-4366-b0f4-48fcce130c06 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.231807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1278/2560] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:40:26 2022] POST /identity/v3/users => generated 304 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:26.236008 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ad6b-1b6b-4dc0-9df7-c72eaae64d2d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.247661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ad6b-1b6b-4dc0-9df7-c72eaae64d2d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.256144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26591bd-1496-4d32-ac03-742f4b1bdeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.256772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26591bd-1496-4d32-ac03-742f4b1bdeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.257049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26591bd-1496-4d32-ac03-742f4b1bdeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.257313 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26591bd-1496-4d32-ac03-742f4b1bdeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.257958 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26591bd-1496-4d32-ac03-742f4b1bdeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.260122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26591bd-1496-4d32-ac03-742f4b1bdeb9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.271340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1283/2561] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:40:26.276448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576f1b-7b43-4366-b0f4-48fcce130c06 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.286625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576f1b-7b43-4366-b0f4-48fcce130c06 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.292007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6fb8a-0236-4b15-9a9f-f971f9fd8a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.292721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6fb8a-0236-4b15-9a9f-f971f9fd8a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.293059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6fb8a-0236-4b15-9a9f-f971f9fd8a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.293395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6fb8a-0236-4b15-9a9f-f971f9fd8a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.294202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6fb8a-0236-4b15-9a9f-f971f9fd8a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.296059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6fb8a-0236-4b15-9a9f-f971f9fd8a08 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.308877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1279/2562] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:40:26.313392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26591bd-1496-4d32-ac03-742f4b1bdeb9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.327489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26591bd-1496-4d32-ac03-742f4b1bdeb9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.332563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892799a9-1310-4b7d-bdfd-db6f72a2d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.333252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892799a9-1310-4b7d-bdfd-db6f72a2d488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.333519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892799a9-1310-4b7d-bdfd-db6f72a2d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.333828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892799a9-1310-4b7d-bdfd-db6f72a2d488 admin admin] PATH_INFO: `/v3/projects/9ece815863944be6b443adaae90e3e9f/users/d6d64e97b6d24f2293fd394ffd202680/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.355960 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892799a9-1310-4b7d-bdfd-db6f72a2d488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ece815863944be6b443adaae90e3e9f, user_id=d6d64e97b6d24f2293fd394ffd202680, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.358834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892799a9-1310-4b7d-bdfd-db6f72a2d488 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.373607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1284/2563] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:26 2022] PUT /identity/v3/projects/9ece815863944be6b443adaae90e3e9f/users/d6d64e97b6d24f2293fd394ffd202680/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:40:26.384188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf2f5-a3a1-48c2-888a-6a5172a28e7e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.384531 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf2f5-a3a1-48c2-888a-6a5172a28e7e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.384890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf2f5-a3a1-48c2-888a-6a5172a28e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.408254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:26.417538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d03bf2f5-a3a1-48c2-888a-6a5172a28e7e None None] MFA Rules not processed for user `d6d64e97b6d24f2293fd394ffd202680`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:26.419676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d03bf2f5-a3a1-48c2-888a-6a5172a28e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:26.502956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1280/2564] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:26 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:26.507558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892799a9-1310-4b7d-bdfd-db6f72a2d488 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.576324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892799a9-1310-4b7d-bdfd-db6f72a2d488 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.583424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835885d5-f7ee-4d50-bca4-e37b1c335082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.584238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835885d5-f7ee-4d50-bca4-e37b1c335082 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.584523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835885d5-f7ee-4d50-bca4-e37b1c335082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.584802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835885d5-f7ee-4d50-bca4-e37b1c335082 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.585459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835885d5-f7ee-4d50-bca4-e37b1c335082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.587475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835885d5-f7ee-4d50-bca4-e37b1c335082 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.622190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1285/2565] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:40:26 2022] POST /identity/v3/projects => generated 407 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:26.623353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf2f5-a3a1-48c2-888a-6a5172a28e7e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.635510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf2f5-a3a1-48c2-888a-6a5172a28e7e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.702741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2706dd9-a89a-4cc9-ae2b-5209d8dcbe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.702741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2706dd9-a89a-4cc9-ae2b-5209d8dcbe68 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.702741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2706dd9-a89a-4cc9-ae2b-5209d8dcbe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.702741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2706dd9-a89a-4cc9-ae2b-5209d8dcbe68 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.703229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2706dd9-a89a-4cc9-ae2b-5209d8dcbe68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.704003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2706dd9-a89a-4cc9-ae2b-5209d8dcbe68 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.726719 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1281/2566] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:40:26 2022] POST /identity/v3/users => generated 310 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:40:26.731428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835885d5-f7ee-4d50-bca4-e37b1c335082 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.742468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835885d5-f7ee-4d50-bca4-e37b1c335082 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.747723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bcebe-7bf6-40d1-9a3c-8b42bf1332d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.748334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bcebe-7bf6-40d1-9a3c-8b42bf1332d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.748613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bcebe-7bf6-40d1-9a3c-8b42bf1332d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.749105 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bcebe-7bf6-40d1-9a3c-8b42bf1332d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.749907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bcebe-7bf6-40d1-9a3c-8b42bf1332d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.751663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bcebe-7bf6-40d1-9a3c-8b42bf1332d3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.766747 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1286/2567] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:40:26.768344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2706dd9-a89a-4cc9-ae2b-5209d8dcbe68 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.780611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2706dd9-a89a-4cc9-ae2b-5209d8dcbe68 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.785521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378d712-6668-49dc-9b97-fe4fd4d470e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.786190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378d712-6668-49dc-9b97-fe4fd4d470e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.786470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378d712-6668-49dc-9b97-fe4fd4d470e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.786911 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378d712-6668-49dc-9b97-fe4fd4d470e9 admin admin] PATH_INFO: `/v3/projects/bf88e210e4954c5583dde36c6a5cc367/users/c950df265fe14e899e318b09bb1e5a96/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.804192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378d712-6668-49dc-9b97-fe4fd4d470e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf88e210e4954c5583dde36c6a5cc367, user_id=c950df265fe14e899e318b09bb1e5a96, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.807503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378d712-6668-49dc-9b97-fe4fd4d470e9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.826056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1282/2568] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:26 2022] PUT /identity/v3/projects/bf88e210e4954c5583dde36c6a5cc367/users/c950df265fe14e899e318b09bb1e5a96/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:26.830232 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bcebe-7bf6-40d1-9a3c-8b42bf1332d3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:26.845986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bcebe-7bf6-40d1-9a3c-8b42bf1332d3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:26.882056 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:26.954484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93360bb2-19e3-425d-aa93-b84c13ccc1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:26.955680 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360bb2-19e3-425d-aa93-b84c13ccc1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:26.955966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360bb2-19e3-425d-aa93-b84c13ccc1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:26.956238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360bb2-19e3-425d-aa93-b84c13ccc1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:26.957062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93360bb2-19e3-425d-aa93-b84c13ccc1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:26.958797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93360bb2-19e3-425d-aa93-b84c13ccc1f6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:26.998048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1287/2569] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:40:26.999752 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378d712-6668-49dc-9b97-fe4fd4d470e9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:27.016618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378d712-6668-49dc-9b97-fe4fd4d470e9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:27.022331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55047b-0890-47f2-9a39-25cdc51542f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:27.023043 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55047b-0890-47f2-9a39-25cdc51542f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:27.023322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55047b-0890-47f2-9a39-25cdc51542f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:27.023590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55047b-0890-47f2-9a39-25cdc51542f2 admin admin] PATH_INFO: `/v3/projects/bf88e210e4954c5583dde36c6a5cc367/users/c950df265fe14e899e318b09bb1e5a96/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:27.026013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55047b-0890-47f2-9a39-25cdc51542f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf88e210e4954c5583dde36c6a5cc367, user_id=c950df265fe14e899e318b09bb1e5a96, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:27.028912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55047b-0890-47f2-9a39-25cdc51542f2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:27.057340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1283/2570] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:26 2022] PUT /identity/v3/projects/bf88e210e4954c5583dde36c6a5cc367/users/c950df265fe14e899e318b09bb1e5a96/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:27.059825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7f5ae-24fe-434f-8fff-24851d8630a2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:27.060676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7f5ae-24fe-434f-8fff-24851d8630a2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:27.061131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7f5ae-24fe-434f-8fff-24851d8630a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:27.112073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-00d7f5ae-24fe-434f-8fff-24851d8630a2 None None] MFA Rules not processed for user `c950df265fe14e899e318b09bb1e5a96`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:27.113541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00d7f5ae-24fe-434f-8fff-24851d8630a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:27.211484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1288/2571] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:27 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:27.222335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55047b-0890-47f2-9a39-25cdc51542f2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:27.224513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8b55047b-0890-47f2-9a39-25cdc51542f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:27.299625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55047b-0890-47f2-9a39-25cdc51542f2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:27.303507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79151a4-9e59-45ca-b54a-22550009523f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:27.304115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79151a4-9e59-45ca-b54a-22550009523f service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:27.304389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79151a4-9e59-45ca-b54a-22550009523f service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:27.304656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79151a4-9e59-45ca-b54a-22550009523f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:27.313603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:27.316244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79151a4-9e59-45ca-b54a-22550009523f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:27.318188 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79151a4-9e59-45ca-b54a-22550009523f service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:27.335135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1284/2572] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:27 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:27.515490 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7f5ae-24fe-434f-8fff-24851d8630a2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:27.526189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7f5ae-24fe-434f-8fff-24851d8630a2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:27.530176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e495f69-81b4-4916-92e7-f88b132c672d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:27.530886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495f69-81b4-4916-92e7-f88b132c672d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:27.531168 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495f69-81b4-4916-92e7-f88b132c672d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:27.531495 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495f69-81b4-4916-92e7-f88b132c672d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:27.599810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e495f69-81b4-4916-92e7-f88b132c672d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:27.601369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e495f69-81b4-4916-92e7-f88b132c672d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:27.621277 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1289/2573] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:27 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:33.091039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79151a4-9e59-45ca-b54a-22550009523f service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:33.153918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79151a4-9e59-45ca-b54a-22550009523f service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:33.158475 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:33.159135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:33.159415 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:33.159687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] PATH_INFO: `/v3/users/d6d64e97b6d24f2293fd394ffd202680` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:33.160933 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d64e97b6d24f2293fd394ffd202680)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:33.162990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:33.213544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d64e97b6d24f2293fd394ffd202680'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.221871 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d64e97b6d24f2293fd394ffd202680'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.222577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d64e97b6d24f2293fd394ffd202680'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.235376 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d64e97b6d24f2293fd394ffd202680'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.242583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d64e97b6d24f2293fd394ffd202680'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.248977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1285/2574] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:33 2022] DELETE /identity/v3/users/d6d64e97b6d24f2293fd394ffd202680 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:33.253534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcac2ad-56d9-488d-b25f-29fefbe57437 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:33.254093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcac2ad-56d9-488d-b25f-29fefbe57437 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:33.254193 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcac2ad-56d9-488d-b25f-29fefbe57437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:33.273126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-abcac2ad-56d9-488d-b25f-29fefbe57437 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:33.274323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-abcac2ad-56d9-488d-b25f-29fefbe57437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:33.318298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:33.333219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1290/2575] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:33.343627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:33.345036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:33.401671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b85be-7326-436f-93fd-dddfc8f2fced admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:33.405266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292cb22-d592-400e-a77e-5cedf0d5ca4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:33.405855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292cb22-d592-400e-a77e-5cedf0d5ca4f service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:33.406132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292cb22-d592-400e-a77e-5cedf0d5ca4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:33.406397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292cb22-d592-400e-a77e-5cedf0d5ca4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:33.415202 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292cb22-d592-400e-a77e-5cedf0d5ca4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:33.416614 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292cb22-d592-400e-a77e-5cedf0d5ca4f service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:33.425850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1286/2576] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:33.699879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcac2ad-56d9-488d-b25f-29fefbe57437 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:33.701654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-abcac2ad-56d9-488d-b25f-29fefbe57437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:33.716343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcac2ad-56d9-488d-b25f-29fefbe57437 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:33.721404 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:33.722004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:33.722351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:33.722774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] PATH_INFO: `/v3/projects/9ece815863944be6b443adaae90e3e9f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:33.724055 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ece815863944be6b443adaae90e3e9f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:33.726051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:33.779345 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ece815863944be6b443adaae90e3e9f', 'request_id': 'req-71016b35-dec2-4a08-89c7-46c09012cfc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.787086 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ece815863944be6b443adaae90e3e9f', 'request_id': 'req-71016b35-dec2-4a08-89c7-46c09012cfc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.794444 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ece815863944be6b443adaae90e3e9f', 'request_id': 'req-71016b35-dec2-4a08-89c7-46c09012cfc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.805763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] The token cache is being invalidate because project 9ece815863944be6b443adaae90e3e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:33.806614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.807328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.808831 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1291/2577] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:33 2022] DELETE /identity/v3/projects/9ece815863944be6b443adaae90e3e9f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:33.812772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292cb22-d592-400e-a77e-5cedf0d5ca4f service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:33.823525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292cb22-d592-400e-a77e-5cedf0d5ca4f service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:33.836864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:33.886355 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:33.887021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:33.887305 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:33.887607 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] PATH_INFO: `/v3/users/c950df265fe14e899e318b09bb1e5a96` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:33.888837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c950df265fe14e899e318b09bb1e5a96)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:33.890713 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:33.937071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c950df265fe14e899e318b09bb1e5a96'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.944694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c950df265fe14e899e318b09bb1e5a96'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.945311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c950df265fe14e899e318b09bb1e5a96'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.960096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c950df265fe14e899e318b09bb1e5a96'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.967258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1288e308-dfee-4115-8bcc-756c7a72213f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c950df265fe14e899e318b09bb1e5a96'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:33.973416 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1287/2578] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:33 2022] DELETE /identity/v3/users/c950df265fe14e899e318b09bb1e5a96 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:34.248446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:34.249907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:34.263820 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016b35-dec2-4a08-89c7-46c09012cfc0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:34.333409 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:34.334095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.334368 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.334643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] PATH_INFO: `/v3/projects/bf88e210e4954c5583dde36c6a5cc367` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.336286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf88e210e4954c5583dde36c6a5cc367)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:34.338723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:34.388983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf88e210e4954c5583dde36c6a5cc367', 'request_id': 'req-aaefd6ba-6218-410a-abf8-f7fc84ab0161'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:34.397603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf88e210e4954c5583dde36c6a5cc367', 'request_id': 'req-aaefd6ba-6218-410a-abf8-f7fc84ab0161'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:34.403737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf88e210e4954c5583dde36c6a5cc367', 'request_id': 'req-aaefd6ba-6218-410a-abf8-f7fc84ab0161'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:34.414854 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] The token cache is being invalidate because project bf88e210e4954c5583dde36c6a5cc367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:34.415137 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:34.416343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aaefd6ba-6218-410a-abf8-f7fc84ab0161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:34.417858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1292/2579] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:34 2022] DELETE /identity/v3/projects/bf88e210e4954c5583dde36c6a5cc367 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:34.422628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4522b7-0f53-4261-862b-127a055e8c67 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.423156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4522b7-0f53-4261-862b-127a055e8c67 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.423407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4522b7-0f53-4261-862b-127a055e8c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.444019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9c4522b7-0f53-4261-862b-127a055e8c67 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:34.445299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9c4522b7-0f53-4261-862b-127a055e8c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:34.506245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1288/2580] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:34.514005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c25a92-2a3a-43c5-84e1-e5b116a0777e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.514290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c25a92-2a3a-43c5-84e1-e5b116a0777e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.514562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c25a92-2a3a-43c5-84e1-e5b116a0777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.523506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:34.537806 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a1c25a92-2a3a-43c5-84e1-e5b116a0777e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:34.539101 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a1c25a92-2a3a-43c5-84e1-e5b116a0777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:34.547932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1293/2581] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:34.552107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4522b7-0f53-4261-862b-127a055e8c67 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:34.562417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4522b7-0f53-4261-862b-127a055e8c67 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:34.568410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bb497-8401-4645-ba86-57a86834d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:34.569008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bb497-8401-4645-ba86-57a86834d981 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.569281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bb497-8401-4645-ba86-57a86834d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.569548 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bb497-8401-4645-ba86-57a86834d981 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.570189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bb497-8401-4645-ba86-57a86834d981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:40:34.571326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bb497-8401-4645-ba86-57a86834d981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:34.573066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bb497-8401-4645-ba86-57a86834d981 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:34.586125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1289/2582] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:40:34.591480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c25a92-2a3a-43c5-84e1-e5b116a0777e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:34.600800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c25a92-2a3a-43c5-84e1-e5b116a0777e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:34.606266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2d099-63c4-4d26-ac7a-3d660d180f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:34.606905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2d099-63c4-4d26-ac7a-3d660d180f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.607186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2d099-63c4-4d26-ac7a-3d660d180f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.607461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2d099-63c4-4d26-ac7a-3d660d180f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.608100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2d099-63c4-4d26-ac7a-3d660d180f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:34.610034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2d099-63c4-4d26-ac7a-3d660d180f48 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:34.642067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1294/2583] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:40:34 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:34.643242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bb497-8401-4645-ba86-57a86834d981 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:34.654426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bb497-8401-4645-ba86-57a86834d981 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:34.679954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:34.721063 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2345f-5219-46fa-af09-f027cb59b95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:34.721706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2345f-5219-46fa-af09-f027cb59b95e admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.721984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2345f-5219-46fa-af09-f027cb59b95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.722256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2345f-5219-46fa-af09-f027cb59b95e admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.722918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2345f-5219-46fa-af09-f027cb59b95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:34.724883 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2345f-5219-46fa-af09-f027cb59b95e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:34.746636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1290/2584] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:40:34 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:40:34.750906 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2d099-63c4-4d26-ac7a-3d660d180f48 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:34.762236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2d099-63c4-4d26-ac7a-3d660d180f48 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:34.767573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e097af-7c21-4fc4-9f80-80596d1f9c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:34.768187 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e097af-7c21-4fc4-9f80-80596d1f9c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.768470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e097af-7c21-4fc4-9f80-80596d1f9c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.768744 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e097af-7c21-4fc4-9f80-80596d1f9c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.769418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e097af-7c21-4fc4-9f80-80596d1f9c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:34.771053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e097af-7c21-4fc4-9f80-80596d1f9c23 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:34.785286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1295/2585] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:40:34.786403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2345f-5219-46fa-af09-f027cb59b95e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:34.799234 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2345f-5219-46fa-af09-f027cb59b95e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:34.806963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f1ee2-f7f9-4262-a1c3-79079da77275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:34.808156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1ee2-f7f9-4262-a1c3-79079da77275 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.808743 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1ee2-f7f9-4262-a1c3-79079da77275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.809235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1ee2-f7f9-4262-a1c3-79079da77275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.811191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f1ee2-f7f9-4262-a1c3-79079da77275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:34.813111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f1ee2-f7f9-4262-a1c3-79079da77275 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:34.824654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1291/2586] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:40:34.828817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e097af-7c21-4fc4-9f80-80596d1f9c23 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:34.839527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e097af-7c21-4fc4-9f80-80596d1f9c23 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:34.844120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61212c1-42a3-4f8c-af62-d2bbb0738766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:34.844758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61212c1-42a3-4f8c-af62-d2bbb0738766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.845036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61212c1-42a3-4f8c-af62-d2bbb0738766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.845309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61212c1-42a3-4f8c-af62-d2bbb0738766 admin admin] PATH_INFO: `/v3/projects/f5df396686104fc59183fd8e82c5a9f8/users/52c22dbcc53c45bda61a615cf4dbb1dd/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.859633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61212c1-42a3-4f8c-af62-d2bbb0738766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5df396686104fc59183fd8e82c5a9f8, user_id=52c22dbcc53c45bda61a615cf4dbb1dd, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:34.862279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61212c1-42a3-4f8c-af62-d2bbb0738766 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:34.875866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1296/2587] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:34 2022] PUT /identity/v3/projects/f5df396686104fc59183fd8e82c5a9f8/users/52c22dbcc53c45bda61a615cf4dbb1dd/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:34.886764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e46cc-4bb4-40fb-b95c-10919707776a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:34.887050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e46cc-4bb4-40fb-b95c-10919707776a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:34.887320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e46cc-4bb4-40fb-b95c-10919707776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:34.914872 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-265e46cc-4bb4-40fb-b95c-10919707776a None None] MFA Rules not processed for user `52c22dbcc53c45bda61a615cf4dbb1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:34.916236 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-265e46cc-4bb4-40fb-b95c-10919707776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:34.980689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1292/2588] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:34.991860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61212c1-42a3-4f8c-af62-d2bbb0738766 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:34.993571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b61212c1-42a3-4f8c-af62-d2bbb0738766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:35.050776 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61212c1-42a3-4f8c-af62-d2bbb0738766 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:35.054355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79560d-19d6-4323-aff1-ac59beb8cf09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb50ee2f9ccd4a258f3396074db66e74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:35.055110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79560d-19d6-4323-aff1-ac59beb8cf09 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:35.055263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79560d-19d6-4323-aff1-ac59beb8cf09 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:35.055537 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79560d-19d6-4323-aff1-ac59beb8cf09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:35.064474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79560d-19d6-4323-aff1-ac59beb8cf09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:35.065951 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79560d-19d6-4323-aff1-ac59beb8cf09 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:35.076786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1297/2589] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:40.603939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc68abd-4605-4520-8eb6-394bd6628f27 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:40.604512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc68abd-4605-4520-8eb6-394bd6628f27 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:40.604627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc68abd-4605-4520-8eb6-394bd6628f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:40.626062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-edc68abd-4605-4520-8eb6-394bd6628f27 None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:40.627306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-edc68abd-4605-4520-8eb6-394bd6628f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:40.684781 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1293/2590] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 31 11:40:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:40.696633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79560d-19d6-4323-aff1-ac59beb8cf09 service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:40.698024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7d79560d-19d6-4323-aff1-ac59beb8cf09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:40.775767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79560d-19d6-4323-aff1-ac59beb8cf09 service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:40.783013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef7aa0-aab2-4450-8fc4-aea49b6353a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:40.783635 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7aa0-aab2-4450-8fc4-aea49b6353a8 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:40.783918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7aa0-aab2-4450-8fc4-aea49b6353a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:40.784192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7aa0-aab2-4450-8fc4-aea49b6353a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:40.793230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef7aa0-aab2-4450-8fc4-aea49b6353a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:40.794860 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef7aa0-aab2-4450-8fc4-aea49b6353a8 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:40.803204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1298/2591] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:40:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:40:50.677049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:50.768331 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc68abd-4605-4520-8eb6-394bd6628f27 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:50.799657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=83,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:50.835771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc68abd-4605-4520-8eb6-394bd6628f27 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:50.840178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:50.840807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:50.841080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:50.841339 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] PATH_INFO: `/v3/users/52c22dbcc53c45bda61a615cf4dbb1dd` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:50.842462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c22dbcc53c45bda61a615cf4dbb1dd)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:50.844420 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:50.890270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c22dbcc53c45bda61a615cf4dbb1dd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:50.897258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c22dbcc53c45bda61a615cf4dbb1dd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:50.897877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c22dbcc53c45bda61a615cf4dbb1dd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:50.910349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c22dbcc53c45bda61a615cf4dbb1dd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:50.917167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c22dbcc53c45bda61a615cf4dbb1dd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:50.924177 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1294/2592] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:50 2022] DELETE /identity/v3/users/52c22dbcc53c45bda61a615cf4dbb1dd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:50.928743 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6df4-44ce-425c-beb5-5a94fd2a9d55 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:50.929026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6df4-44ce-425c-beb5-5a94fd2a9d55 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:50.929301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6df4-44ce-425c-beb5-5a94fd2a9d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:50.948339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-75fd6df4-44ce-425c-beb5-5a94fd2a9d55 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:50.949526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-75fd6df4-44ce-425c-beb5-5a94fd2a9d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:51.009276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1299/2593] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:51.019059 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:51.020454 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:51.076818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e723f9e-a6b0-4553-b6bb-ed09166a03a1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:51.080468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8143ded-574f-497c-88aa-d2ea72cbe1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:51.081071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8143ded-574f-497c-88aa-d2ea72cbe1df service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.081349 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8143ded-574f-497c-88aa-d2ea72cbe1df service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.081618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8143ded-574f-497c-88aa-d2ea72cbe1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.091192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8143ded-574f-497c-88aa-d2ea72cbe1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:51.092621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8143ded-574f-497c-88aa-d2ea72cbe1df service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:51.101841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1295/2594] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:51.369964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd6df4-44ce-425c-beb5-5a94fd2a9d55 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:51.371420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-75fd6df4-44ce-425c-beb5-5a94fd2a9d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:51.388102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd6df4-44ce-425c-beb5-5a94fd2a9d55 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:51.394471 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:51.395190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.395510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.395709 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] PATH_INFO: `/v3/projects/f5df396686104fc59183fd8e82c5a9f8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.397005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5df396686104fc59183fd8e82c5a9f8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:51.398953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:51.446169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5df396686104fc59183fd8e82c5a9f8', 'request_id': 'req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:51.456120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5df396686104fc59183fd8e82c5a9f8', 'request_id': 'req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:51.461962 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5df396686104fc59183fd8e82c5a9f8', 'request_id': 'req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:51.473836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] The token cache is being invalidate because project f5df396686104fc59183fd8e82c5a9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:51.474157 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:51.474840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06b5e17d-f0ef-4c23-b208-8fade09f8ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:51.479817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1300/2595] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:51 2022] DELETE /identity/v3/projects/f5df396686104fc59183fd8e82c5a9f8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:51.481655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7909f-af32-423e-8ab6-4a76de52dd1b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.481926 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7909f-af32-423e-8ab6-4a76de52dd1b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.482201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7909f-af32-423e-8ab6-4a76de52dd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.503835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7cf7909f-af32-423e-8ab6-4a76de52dd1b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:51.505068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7cf7909f-af32-423e-8ab6-4a76de52dd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:51.522905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:51.569444 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1296/2596] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:40:51.579309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e4828-cbc2-4d29-9c51-02740770056d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.579701 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e4828-cbc2-4d29-9c51-02740770056d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.580132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e4828-cbc2-4d29-9c51-02740770056d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.601439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-064e4828-cbc2-4d29-9c51-02740770056d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:51.602644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-064e4828-cbc2-4d29-9c51-02740770056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:51.611024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1301/2597] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:51.616792 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7909f-af32-423e-8ab6-4a76de52dd1b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:51.626288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7909f-af32-423e-8ab6-4a76de52dd1b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:51.632206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aca65e-8278-4d7d-bf4d-c02ab4662135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:51.632812 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca65e-8278-4d7d-bf4d-c02ab4662135 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.633089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca65e-8278-4d7d-bf4d-c02ab4662135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.633360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca65e-8278-4d7d-bf4d-c02ab4662135 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.634010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aca65e-8278-4d7d-bf4d-c02ab4662135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:40:51.634311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aca65e-8278-4d7d-bf4d-c02ab4662135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:51.636051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aca65e-8278-4d7d-bf4d-c02ab4662135 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:51.653634 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1297/2598] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:40:51.654357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e4828-cbc2-4d29-9c51-02740770056d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:51.664921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e4828-cbc2-4d29-9c51-02740770056d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:51.669811 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf1179-d4f1-4e3d-948b-ae3e56bb550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:51.670565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf1179-d4f1-4e3d-948b-ae3e56bb550e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.671275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf1179-d4f1-4e3d-948b-ae3e56bb550e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.671588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf1179-d4f1-4e3d-948b-ae3e56bb550e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.672287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf1179-d4f1-4e3d-948b-ae3e56bb550e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:51.674322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf1179-d4f1-4e3d-948b-ae3e56bb550e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:51.676557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4771-18ae-4232-b964-4e5a23c227a3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.676848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4771-18ae-4232-b964-4e5a23c227a3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.677124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4771-18ae-4232-b964-4e5a23c227a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.698445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-454c4771-18ae-4232-b964-4e5a23c227a3 None None] MFA Rules not processed for user `660b505867744099a74f3ade6bad2d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:51.700403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-454c4771-18ae-4232-b964-4e5a23c227a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:51.708966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1302/2599] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:40:51 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:51.709956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf1179-d4f1-4e3d-948b-ae3e56bb550e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:51.760561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1298/2600] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 31 11:40:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:40:51.769058 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:51.774161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4771-18ae-4232-b964-4e5a23c227a3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:51.775562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-454c4771-18ae-4232-b964-4e5a23c227a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:51.775689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf1179-d4f1-4e3d-948b-ae3e56bb550e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:51.781911 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c1c7-e90a-4e51-9139-841c8cc0bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:51.782583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c1c7-e90a-4e51-9139-841c8cc0bf56 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.783392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c1c7-e90a-4e51-9139-841c8cc0bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.783790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c1c7-e90a-4e51-9139-841c8cc0bf56 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.784494 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c1c7-e90a-4e51-9139-841c8cc0bf56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:51.786563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c1c7-e90a-4e51-9139-841c8cc0bf56 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:51.808214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1303/2601] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:40:51 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:51.813166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c1c7-e90a-4e51-9139-841c8cc0bf56 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:51.822777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c1c7-e90a-4e51-9139-841c8cc0bf56 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:51.828272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc81e3-c72f-4354-87d4-e3e497e75955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:51.828858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc81e3-c72f-4354-87d4-e3e497e75955 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.829135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc81e3-c72f-4354-87d4-e3e497e75955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.829397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc81e3-c72f-4354-87d4-e3e497e75955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.830037 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc81e3-c72f-4354-87d4-e3e497e75955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:51.831687 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc81e3-c72f-4354-87d4-e3e497e75955 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:51.841774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1304/2602] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:40:51.845759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc81e3-c72f-4354-87d4-e3e497e75955 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:51.850507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4771-18ae-4232-b964-4e5a23c227a3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:51.855520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc81e3-c72f-4354-87d4-e3e497e75955 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:51.860244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357a25f-49fb-4187-8726-a96a609f8ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:51.860829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357a25f-49fb-4187-8726-a96a609f8ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.861112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357a25f-49fb-4187-8726-a96a609f8ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.861389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357a25f-49fb-4187-8726-a96a609f8ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.862023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357a25f-49fb-4187-8726-a96a609f8ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:51.863667 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357a25f-49fb-4187-8726-a96a609f8ea9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:51.875771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1305/2603] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:40:51.879362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357a25f-49fb-4187-8726-a96a609f8ea9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:51.890624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357a25f-49fb-4187-8726-a96a609f8ea9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:51.895864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363270d2-cd20-4137-97f5-59e0d66a89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:51.896500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363270d2-cd20-4137-97f5-59e0d66a89f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.896778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363270d2-cd20-4137-97f5-59e0d66a89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.897075 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363270d2-cd20-4137-97f5-59e0d66a89f7 admin admin] PATH_INFO: `/v3/projects/c742eed0d5dd4ef6be1d7419ab14e06f/users/848e201d7c9047e28fdadc6261514bd6/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.903315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:51.911723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363270d2-cd20-4137-97f5-59e0d66a89f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c742eed0d5dd4ef6be1d7419ab14e06f, user_id=848e201d7c9047e28fdadc6261514bd6, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:51.913892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12543e0-8944-4b48-ab5e-94459aa790b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1966d24e4cf4a46b71dc2ec302a8d27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:51.914460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363270d2-cd20-4137-97f5-59e0d66a89f7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:51.914608 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12543e0-8944-4b48-ab5e-94459aa790b7 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.914897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12543e0-8944-4b48-ab5e-94459aa790b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.915295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12543e0-8944-4b48-ab5e-94459aa790b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.927221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1306/2604] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:51 2022] PUT /identity/v3/projects/c742eed0d5dd4ef6be1d7419ab14e06f/users/848e201d7c9047e28fdadc6261514bd6/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:40:51.937836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7de76-6b7a-4a63-844f-5e53d5f1f7bd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:51.938146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7de76-6b7a-4a63-844f-5e53d5f1f7bd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:51.938419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7de76-6b7a-4a63-844f-5e53d5f1f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:51.966833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-68f7de76-6b7a-4a63-844f-5e53d5f1f7bd None None] MFA Rules not processed for user `848e201d7c9047e28fdadc6261514bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:51.967965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-68f7de76-6b7a-4a63-844f-5e53d5f1f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:51.973837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12543e0-8944-4b48-ab5e-94459aa790b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:51.975592 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12543e0-8944-4b48-ab5e-94459aa790b7 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:51.984182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1299/2605] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 31 11:40:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:40:52.036835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1307/2606] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:40:52.072426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12543e0-8944-4b48-ab5e-94459aa790b7 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:52.073980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c12543e0-8944-4b48-ab5e-94459aa790b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:52.139429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12543e0-8944-4b48-ab5e-94459aa790b7 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:52.195715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fa273-2e82-4dc5-9548-24f0923d5261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:52.196369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa273-2e82-4dc5-9548-24f0923d5261 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:52.196644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa273-2e82-4dc5-9548-24f0923d5261 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:52.196913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa273-2e82-4dc5-9548-24f0923d5261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:52.206354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fa273-2e82-4dc5-9548-24f0923d5261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:52.207874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fa273-2e82-4dc5-9548-24f0923d5261 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:52.217007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1300/2607] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:52.234166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7de76-6b7a-4a63-844f-5e53d5f1f7bd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:52.299463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7de76-6b7a-4a63-844f-5e53d5f1f7bd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:52.304273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:52.304883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:52.305166 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:52.305445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] PATH_INFO: `/v3/users/848e201d7c9047e28fdadc6261514bd6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:52.307150 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=848e201d7c9047e28fdadc6261514bd6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:52.308586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:52.347918 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:52.364492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848e201d7c9047e28fdadc6261514bd6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:52.378145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848e201d7c9047e28fdadc6261514bd6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:52.385920 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848e201d7c9047e28fdadc6261514bd6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:52.393955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848e201d7c9047e28fdadc6261514bd6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:52.394759 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848e201d7c9047e28fdadc6261514bd6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:52.401571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1308/2608] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:52 2022] DELETE /identity/v3/users/848e201d7c9047e28fdadc6261514bd6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:52.406800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9871-9c3f-4418-abff-e5b9364da409 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:52.407091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9871-9c3f-4418-abff-e5b9364da409 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:52.407368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9871-9c3f-4418-abff-e5b9364da409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:52.427126 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ba4e9871-9c3f-4418-abff-e5b9364da409 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:52.428563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ba4e9871-9c3f-4418-abff-e5b9364da409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:52.480638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:52.490798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1301/2609] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:52.502322 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:52.503801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:52.564801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8bb71-5fdd-4ca3-ad7f-34acc686ca4d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:52.568603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dc90f-c1c9-428e-ac11-a3a5ce7f83be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:52.569207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dc90f-c1c9-428e-ac11-a3a5ce7f83be service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:52.569513 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dc90f-c1c9-428e-ac11-a3a5ce7f83be service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:52.569782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dc90f-c1c9-428e-ac11-a3a5ce7f83be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:52.579363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dc90f-c1c9-428e-ac11-a3a5ce7f83be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:52.580821 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dc90f-c1c9-428e-ac11-a3a5ce7f83be service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:52.591657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1309/2610] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:53.106707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e9871-9c3f-4418-abff-e5b9364da409 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:53.108458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ba4e9871-9c3f-4418-abff-e5b9364da409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:53.122826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e9871-9c3f-4418-abff-e5b9364da409 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:53.127984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:53.128704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.129047 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.129897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] PATH_INFO: `/v3/projects/c742eed0d5dd4ef6be1d7419ab14e06f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.130567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c742eed0d5dd4ef6be1d7419ab14e06f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:53.132578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:53.190572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c742eed0d5dd4ef6be1d7419ab14e06f', 'request_id': 'req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:53.202303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c742eed0d5dd4ef6be1d7419ab14e06f', 'request_id': 'req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:53.209181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c742eed0d5dd4ef6be1d7419ab14e06f', 'request_id': 'req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:53.227890 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] The token cache is being invalidate because project c742eed0d5dd4ef6be1d7419ab14e06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:53.228173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:53.228886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d4e777e-7cad-4c97-8ff9-615ffdbd27c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:53.230749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1302/2611] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:53 2022] DELETE /identity/v3/projects/c742eed0d5dd4ef6be1d7419ab14e06f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:53.237013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464dc45-da04-40a3-8213-de34205be8f1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.238161 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464dc45-da04-40a3-8213-de34205be8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.239090 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464dc45-da04-40a3-8213-de34205be8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.261501 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c464dc45-da04-40a3-8213-de34205be8f1 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:53.263809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c464dc45-da04-40a3-8213-de34205be8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:53.338145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1310/2612] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:53.345844 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566fbeb-e0de-40b1-87a3-1a446383d84e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.346185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566fbeb-e0de-40b1-87a3-1a446383d84e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.346443 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566fbeb-e0de-40b1-87a3-1a446383d84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.368227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9566fbeb-e0de-40b1-87a3-1a446383d84e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:53.369465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9566fbeb-e0de-40b1-87a3-1a446383d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:53.382937 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1303/2613] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:53.384296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464dc45-da04-40a3-8213-de34205be8f1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:53.397254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464dc45-da04-40a3-8213-de34205be8f1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:53.402613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dba5e-279d-482d-bf73-21763b8cf1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:53.402966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dba5e-279d-482d-bf73-21763b8cf1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.403121 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dba5e-279d-482d-bf73-21763b8cf1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.403511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dba5e-279d-482d-bf73-21763b8cf1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.404273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dba5e-279d-482d-bf73-21763b8cf1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:40:53.405326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dba5e-279d-482d-bf73-21763b8cf1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:53.406432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dba5e-279d-482d-bf73-21763b8cf1c2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:53.420465 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1311/2614] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:40:53.425853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566fbeb-e0de-40b1-87a3-1a446383d84e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:53.436336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566fbeb-e0de-40b1-87a3-1a446383d84e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:53.443541 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ca7e9-8abe-45b4-a81b-da274f8950f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:53.443918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca7e9-8abe-45b4-a81b-da274f8950f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.444193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca7e9-8abe-45b4-a81b-da274f8950f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.444464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca7e9-8abe-45b4-a81b-da274f8950f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.445131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ca7e9-8abe-45b4-a81b-da274f8950f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:53.447079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ca7e9-8abe-45b4-a81b-da274f8950f2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:53.483205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1304/2615] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:40:53 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:53.484793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dba5e-279d-482d-bf73-21763b8cf1c2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:53.495926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dba5e-279d-482d-bf73-21763b8cf1c2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:53.535037 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:53.570699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ab37-4de0-48a2-a59b-21596b4f4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:53.571449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ab37-4de0-48a2-a59b-21596b4f4fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.571801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ab37-4de0-48a2-a59b-21596b4f4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.572148 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ab37-4de0-48a2-a59b-21596b4f4fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.573006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ab37-4de0-48a2-a59b-21596b4f4fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:53.575229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ab37-4de0-48a2-a59b-21596b4f4fe9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:53.599175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1312/2616] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:40:53 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:53.603442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ca7e9-8abe-45b4-a81b-da274f8950f2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:53.615127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ca7e9-8abe-45b4-a81b-da274f8950f2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:53.623005 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a042b1b-b2cd-43b6-8eb0-4526c807442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:53.623876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a042b1b-b2cd-43b6-8eb0-4526c807442c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.624909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a042b1b-b2cd-43b6-8eb0-4526c807442c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.625198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a042b1b-b2cd-43b6-8eb0-4526c807442c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.625888 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a042b1b-b2cd-43b6-8eb0-4526c807442c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:53.627611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a042b1b-b2cd-43b6-8eb0-4526c807442c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:53.639262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1305/2617] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:40:53.643255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ab37-4de0-48a2-a59b-21596b4f4fe9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:53.658063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ab37-4de0-48a2-a59b-21596b4f4fe9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:53.664079 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0f46f-faa2-460d-8642-f8bd1b2bac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:53.664707 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0f46f-faa2-460d-8642-f8bd1b2bac65 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.665041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0f46f-faa2-460d-8642-f8bd1b2bac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.665965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0f46f-faa2-460d-8642-f8bd1b2bac65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.670784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0f46f-faa2-460d-8642-f8bd1b2bac65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:53.670784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0f46f-faa2-460d-8642-f8bd1b2bac65 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:53.693122 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1313/2618] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:40:53.697422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a042b1b-b2cd-43b6-8eb0-4526c807442c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:53.710715 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a042b1b-b2cd-43b6-8eb0-4526c807442c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:53.716225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c03d4-188a-4464-8952-08bf0db2d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:53.716889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c03d4-188a-4464-8952-08bf0db2d85a admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.717203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c03d4-188a-4464-8952-08bf0db2d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.717449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c03d4-188a-4464-8952-08bf0db2d85a admin admin] PATH_INFO: `/v3/projects/1583d0776d614334b622e806203a5c27/users/af629ed004cf4ef285b35b483d83775c/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.747010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c03d4-188a-4464-8952-08bf0db2d85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1583d0776d614334b622e806203a5c27, user_id=af629ed004cf4ef285b35b483d83775c, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:53.750727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c03d4-188a-4464-8952-08bf0db2d85a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:53.781470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aebb3-d99b-4bdb-af50-828ad5b68dee None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.781774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aebb3-d99b-4bdb-af50-828ad5b68dee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.782028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aebb3-d99b-4bdb-af50-828ad5b68dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:53.782636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1306/2619] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:53 2022] PUT /identity/v3/projects/1583d0776d614334b622e806203a5c27/users/af629ed004cf4ef285b35b483d83775c/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:53.819176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-595aebb3-d99b-4bdb-af50-828ad5b68dee None None] MFA Rules not processed for user `af629ed004cf4ef285b35b483d83775c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:53.820454 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-595aebb3-d99b-4bdb-af50-828ad5b68dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:53.904751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1314/2620] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:53.916242 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c03d4-188a-4464-8952-08bf0db2d85a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:53.918079 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-987c03d4-188a-4464-8952-08bf0db2d85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:53.992597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c03d4-188a-4464-8952-08bf0db2d85a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:53.997762 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098ef24-df96-4493-94ba-b3ab6750e7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:53.998353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ef24-df96-4493-94ba-b3ab6750e7cf service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:53.998716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ef24-df96-4493-94ba-b3ab6750e7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:53.999008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ef24-df96-4493-94ba-b3ab6750e7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:54.009504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098ef24-df96-4493-94ba-b3ab6750e7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:54.010920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098ef24-df96-4493-94ba-b3ab6750e7cf service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:54.022255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1307/2621] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:54.239010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348ca68-db8f-42f1-ad82-ca9c0e2d36b3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:54.239573 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348ca68-db8f-42f1-ad82-ca9c0e2d36b3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:54.239801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348ca68-db8f-42f1-ad82-ca9c0e2d36b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:54.260395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5348ca68-db8f-42f1-ad82-ca9c0e2d36b3 None None] MFA Rules not processed for user `aee105e9d1ee44f985fdbac834330afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:54.261712 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5348ca68-db8f-42f1-ad82-ca9c0e2d36b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:54.354046 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1315/2622] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:57.408689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098ef24-df96-4493-94ba-b3ab6750e7cf service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:57.433796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:57.499211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098ef24-df96-4493-94ba-b3ab6750e7cf service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:57.507060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:57.507544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:57.508006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:57.508564 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] PATH_INFO: `/v3/users/af629ed004cf4ef285b35b483d83775c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:57.509939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af629ed004cf4ef285b35b483d83775c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:57.512037 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:57.580559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af629ed004cf4ef285b35b483d83775c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:57.592336 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af629ed004cf4ef285b35b483d83775c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:57.594480 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af629ed004cf4ef285b35b483d83775c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:57.623285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af629ed004cf4ef285b35b483d83775c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:57.632638 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af629ed004cf4ef285b35b483d83775c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:57.639826 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1308/2623] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:57 2022] DELETE /identity/v3/users/af629ed004cf4ef285b35b483d83775c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:57.644341 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675b3eb-d2aa-488b-8d44-a999912a42a5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:57.644829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675b3eb-d2aa-488b-8d44-a999912a42a5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:57.644915 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675b3eb-d2aa-488b-8d44-a999912a42a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:57.691847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9675b3eb-d2aa-488b-8d44-a999912a42a5 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:57.693111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9675b3eb-d2aa-488b-8d44-a999912a42a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:57.778539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:57.799647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1316/2624] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:57.813695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:57.815211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:57.919814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c03f-b800-4eea-b3f8-d7010997097e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:57.924519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07db6c-e345-4638-9617-97240ef4f374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:57.925711 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07db6c-e345-4638-9617-97240ef4f374 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:57.926221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07db6c-e345-4638-9617-97240ef4f374 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:57.926761 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07db6c-e345-4638-9617-97240ef4f374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:57.937894 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07db6c-e345-4638-9617-97240ef4f374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:57.940227 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07db6c-e345-4638-9617-97240ef4f374 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:57.960736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1309/2625] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:58.667884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675b3eb-d2aa-488b-8d44-a999912a42a5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:58.673249 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9675b3eb-d2aa-488b-8d44-a999912a42a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:58.701492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675b3eb-d2aa-488b-8d44-a999912a42a5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:58.708505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:58.709194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:58.709475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:58.709947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] PATH_INFO: `/v3/projects/1583d0776d614334b622e806203a5c27` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:58.712234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1583d0776d614334b622e806203a5c27)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:58.716258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:58.807468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1583d0776d614334b622e806203a5c27', 'request_id': 'req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:58.817512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1583d0776d614334b622e806203a5c27', 'request_id': 'req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:58.825802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1583d0776d614334b622e806203a5c27', 'request_id': 'req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:58.845273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] The token cache is being invalidate because project 1583d0776d614334b622e806203a5c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:58.845891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:58.847696 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-93fd215c-ef29-4a3c-a3d0-9a5179ef685e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:58.851992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1317/2626] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:58 2022] DELETE /identity/v3/projects/1583d0776d614334b622e806203a5c27 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:58.857974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565608b-d0f5-42c4-b747-4d2c7631a355 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:58.860001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565608b-d0f5-42c4-b747-4d2c7631a355 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:58.860001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565608b-d0f5-42c4-b747-4d2c7631a355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:58.887870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4565608b-d0f5-42c4-b747-4d2c7631a355 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:58.889102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4565608b-d0f5-42c4-b747-4d2c7631a355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:58.947189 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:58.998772 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1310/2627] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:59.000509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2264-4ed2-4d94-ad04-4b5b82e1955e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:59.000803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2264-4ed2-4d94-ad04-4b5b82e1955e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:59.001088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2264-4ed2-4d94-ad04-4b5b82e1955e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:59.026727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dd9b2264-4ed2-4d94-ad04-4b5b82e1955e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:59.029748 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dd9b2264-4ed2-4d94-ad04-4b5b82e1955e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:59.051098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1318/2628] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:59.055742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565608b-d0f5-42c4-b747-4d2c7631a355 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:59.070268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565608b-d0f5-42c4-b747-4d2c7631a355 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:59.078727 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc92c-761c-4c1f-a34d-bf35cd2a38d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:59.089971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc92c-761c-4c1f-a34d-bf35cd2a38d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:59.094011 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc92c-761c-4c1f-a34d-bf35cd2a38d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:59.094361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc92c-761c-4c1f-a34d-bf35cd2a38d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:59.095243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc92c-761c-4c1f-a34d-bf35cd2a38d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:40:59.098439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc92c-761c-4c1f-a34d-bf35cd2a38d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:59.100086 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc92c-761c-4c1f-a34d-bf35cd2a38d4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:59.129001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1311/2629] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:40:59.133732 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2264-4ed2-4d94-ad04-4b5b82e1955e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:59.143374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2264-4ed2-4d94-ad04-4b5b82e1955e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:59.148169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed20de-f272-4565-99ce-a2af0db1b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:59.148797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed20de-f272-4565-99ce-a2af0db1b619 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:59.149062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed20de-f272-4565-99ce-a2af0db1b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:59.149333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed20de-f272-4565-99ce-a2af0db1b619 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:59.150155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed20de-f272-4565-99ce-a2af0db1b619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:59.152103 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed20de-f272-4565-99ce-a2af0db1b619 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:59.188120 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1319/2630] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:40:59 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:59.192162 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc92c-761c-4c1f-a34d-bf35cd2a38d4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:59.203300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc92c-761c-4c1f-a34d-bf35cd2a38d4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:59.273896 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03415bf3-ab9e-4dba-a5c4-81565bc44733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:59.274511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03415bf3-ab9e-4dba-a5c4-81565bc44733 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:59.274889 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03415bf3-ab9e-4dba-a5c4-81565bc44733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:59.275168 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03415bf3-ab9e-4dba-a5c4-81565bc44733 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:59.275800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03415bf3-ab9e-4dba-a5c4-81565bc44733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:59.278272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03415bf3-ab9e-4dba-a5c4-81565bc44733 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:59.301511 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1312/2631] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:40:59 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:40:59.305994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed20de-f272-4565-99ce-a2af0db1b619 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:59.317114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed20de-f272-4565-99ce-a2af0db1b619 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:59.321792 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc116-6592-4777-aeef-03a1fa073334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:59.322392 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc116-6592-4777-aeef-03a1fa073334 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:59.322670 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc116-6592-4777-aeef-03a1fa073334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:59.322981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc116-6592-4777-aeef-03a1fa073334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:59.325155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc116-6592-4777-aeef-03a1fa073334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:59.326215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc116-6592-4777-aeef-03a1fa073334 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:59.336663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1320/2632] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:40:59.341660 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03415bf3-ab9e-4dba-a5c4-81565bc44733 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:59.351651 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03415bf3-ab9e-4dba-a5c4-81565bc44733 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:59.356269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bba5ce-ae05-4d6d-9301-6cbe36f25edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:59.356876 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba5ce-ae05-4d6d-9301-6cbe36f25edd admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:59.357150 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba5ce-ae05-4d6d-9301-6cbe36f25edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:59.357422 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba5ce-ae05-4d6d-9301-6cbe36f25edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:59.358061 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bba5ce-ae05-4d6d-9301-6cbe36f25edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:59.359680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bba5ce-ae05-4d6d-9301-6cbe36f25edd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:59.370587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1313/2633] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:40:59.374810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc116-6592-4777-aeef-03a1fa073334 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:59.384690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc116-6592-4777-aeef-03a1fa073334 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:59.389927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7189c80-714b-47b2-86a8-569f6b9edc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:59.390584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7189c80-714b-47b2-86a8-569f6b9edc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:59.390983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7189c80-714b-47b2-86a8-569f6b9edc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:59.391158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7189c80-714b-47b2-86a8-569f6b9edc51 admin admin] PATH_INFO: `/v3/projects/312ad5761c9c43c5ab7f4530f41705dd/users/ce85d888fba14bf3aec4c60540a9a555/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:59.414528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7189c80-714b-47b2-86a8-569f6b9edc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312ad5761c9c43c5ab7f4530f41705dd, user_id=ce85d888fba14bf3aec4c60540a9a555, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:59.417233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7189c80-714b-47b2-86a8-569f6b9edc51 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:59.429994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1321/2634] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:40:59 2022] PUT /identity/v3/projects/312ad5761c9c43c5ab7f4530f41705dd/users/ce85d888fba14bf3aec4c60540a9a555/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:40:59.442411 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccae508-f875-41d7-a39c-0007f5d45c90 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:59.444377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccae508-f875-41d7-a39c-0007f5d45c90 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:59.444695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccae508-f875-41d7-a39c-0007f5d45c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:59.476338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2ccae508-f875-41d7-a39c-0007f5d45c90 None None] MFA Rules not processed for user `ce85d888fba14bf3aec4c60540a9a555`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:59.477483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2ccae508-f875-41d7-a39c-0007f5d45c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:59.546321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1314/2635] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:40:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:59.557824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7189c80-714b-47b2-86a8-569f6b9edc51 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:59.559830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d7189c80-714b-47b2-86a8-569f6b9edc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:59.657929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7189c80-714b-47b2-86a8-569f6b9edc51 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:59.661910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207e45c-1fec-4914-b935-d121c27b395c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb50ee2f9ccd4a258f3396074db66e74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:59.663604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e45c-1fec-4914-b935-d121c27b395c service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:59.663604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e45c-1fec-4914-b935-d121c27b395c service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:59.663604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e45c-1fec-4914-b935-d121c27b395c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:59.677690 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207e45c-1fec-4914-b935-d121c27b395c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:59.679326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207e45c-1fec-4914-b935-d121c27b395c service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:59.690721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1322/2636] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:00.734552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccae508-f875-41d7-a39c-0007f5d45c90 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:00.736446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2ccae508-f875-41d7-a39c-0007f5d45c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:00.787825 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:00.816616 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccae508-f875-41d7-a39c-0007f5d45c90 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:00.821258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:00.821944 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:00.822224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:00.822496 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] PATH_INFO: `/v3/users/1d77d47dbe764730aecc3e6506c3b0f0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:00.823673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d77d47dbe764730aecc3e6506c3b0f0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:00.825620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:00.873528 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d77d47dbe764730aecc3e6506c3b0f0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:00.881404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d77d47dbe764730aecc3e6506c3b0f0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:00.882132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d77d47dbe764730aecc3e6506c3b0f0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:00.894839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d77d47dbe764730aecc3e6506c3b0f0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:00.902706 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d77d47dbe764730aecc3e6506c3b0f0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:00.909518 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1315/2637] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:00 2022] DELETE /identity/v3/users/1d77d47dbe764730aecc3e6506c3b0f0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:01.086351 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207e45c-1fec-4914-b935-d121c27b395c service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:01.103218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207e45c-1fec-4914-b935-d121c27b395c service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:01.116024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:01.167916 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:01.169155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:01.169398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:01.169673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] PATH_INFO: `/v3/projects/e3c91374ff9942f6a1d9a488e46507f6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:01.170887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c91374ff9942f6a1d9a488e46507f6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:01.172839 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:01.219627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c91374ff9942f6a1d9a488e46507f6', 'request_id': 'req-e71ba9d0-358d-4896-ac58-81ffd6194fd4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.228130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c91374ff9942f6a1d9a488e46507f6', 'request_id': 'req-e71ba9d0-358d-4896-ac58-81ffd6194fd4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.236209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c91374ff9942f6a1d9a488e46507f6', 'request_id': 'req-e71ba9d0-358d-4896-ac58-81ffd6194fd4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.248145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] The token cache is being invalidate because project e3c91374ff9942f6a1d9a488e46507f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:01.248440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.249108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.250739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1323/2638] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:01 2022] DELETE /identity/v3/projects/e3c91374ff9942f6a1d9a488e46507f6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:01.255300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:01.256949 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:01.270730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3057d-f68a-43a0-966e-060896175b9f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:01.333399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:01.334050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:01.334316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:01.334730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] PATH_INFO: `/v3/users/ebf1089b392a45c8ad6bd64db8ea441e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:01.336025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf1089b392a45c8ad6bd64db8ea441e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:01.337995 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:01.385503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf1089b392a45c8ad6bd64db8ea441e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.393071 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf1089b392a45c8ad6bd64db8ea441e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.393724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf1089b392a45c8ad6bd64db8ea441e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.398965 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:01.409909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf1089b392a45c8ad6bd64db8ea441e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.416815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf1089b392a45c8ad6bd64db8ea441e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.423556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1316/2639] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:01 2022] DELETE /identity/v3/users/ebf1089b392a45c8ad6bd64db8ea441e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:01.611382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:01.612919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:01.639994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ba9d0-358d-4896-ac58-81ffd6194fd4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:01.710523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:01.711394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:01.711695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:01.712119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] PATH_INFO: `/v3/projects/5e989f0bbf5e44068fbc4d81a516fd87` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:01.713250 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e989f0bbf5e44068fbc4d81a516fd87)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:01.715226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:01.764066 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:01.767376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e989f0bbf5e44068fbc4d81a516fd87', 'request_id': 'req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.775379 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e989f0bbf5e44068fbc4d81a516fd87', 'request_id': 'req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.781521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e989f0bbf5e44068fbc4d81a516fd87', 'request_id': 'req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.792836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] The token cache is being invalidate because project 5e989f0bbf5e44068fbc4d81a516fd87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:01.793126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.794425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5f11cbe3-dd8e-4d30-944b-3b82a64ea564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:01.795933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1324/2640] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:01 2022] DELETE /identity/v3/projects/5e989f0bbf5e44068fbc4d81a516fd87 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:11.420085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=2,keystone:SELECT=9 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:11.789577 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:22.615524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:22.617138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:22.630149 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b7f81-ad4e-43c3-96ef-f2cfddd623fe admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:22.686341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:22.687005 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:22.687288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:22.687567 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] PATH_INFO: `/v3/users/ce85d888fba14bf3aec4c60540a9a555` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:22.688698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce85d888fba14bf3aec4c60540a9a555)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:22.690627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:22.740654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce85d888fba14bf3aec4c60540a9a555'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:22.749284 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce85d888fba14bf3aec4c60540a9a555'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:22.750001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce85d888fba14bf3aec4c60540a9a555'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:22.762413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce85d888fba14bf3aec4c60540a9a555'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:22.770296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce85d888fba14bf3aec4c60540a9a555'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:22.776485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1317/2641] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:22 2022] DELETE /identity/v3/users/ce85d888fba14bf3aec4c60540a9a555 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:22.781868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd466-52a4-4b4c-8ac3-66798a6fc186 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:22.782354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd466-52a4-4b4c-8ac3-66798a6fc186 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:22.782554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd466-52a4-4b4c-8ac3-66798a6fc186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:22.801817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0f6bd466-52a4-4b4c-8ac3-66798a6fc186 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:22.803059 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0f6bd466-52a4-4b4c-8ac3-66798a6fc186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:22.864663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1325/2642] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:22.875417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:22.876943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:22.940687 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03356591-4280-4edb-9af8-cb0bd7fcceef admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:22.944428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e52db2-a363-4def-b7ad-f946f16c47a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:22.945034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e52db2-a363-4def-b7ad-f946f16c47a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:22.945312 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e52db2-a363-4def-b7ad-f946f16c47a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:22.945583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e52db2-a363-4def-b7ad-f946f16c47a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:22.955538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e52db2-a363-4def-b7ad-f946f16c47a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:22.956982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e52db2-a363-4def-b7ad-f946f16c47a5 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:22.966952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1318/2643] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:23.270115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd466-52a4-4b4c-8ac3-66798a6fc186 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:23.273706 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0f6bd466-52a4-4b4c-8ac3-66798a6fc186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:23.301329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd466-52a4-4b4c-8ac3-66798a6fc186 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:23.307064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:23.307841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.308131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.308417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] PATH_INFO: `/v3/projects/312ad5761c9c43c5ab7f4530f41705dd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.310251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=312ad5761c9c43c5ab7f4530f41705dd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:23.312425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:23.380309 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312ad5761c9c43c5ab7f4530f41705dd', 'request_id': 'req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:23.391052 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312ad5761c9c43c5ab7f4530f41705dd', 'request_id': 'req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:23.397342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312ad5761c9c43c5ab7f4530f41705dd', 'request_id': 'req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:23.408559 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] The token cache is being invalidate because project 312ad5761c9c43c5ab7f4530f41705dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:23.408905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:23.409553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f1f0bb6f-b157-4fcd-9adb-e666b8cad612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:23.411081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1326/2644] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:23 2022] DELETE /identity/v3/projects/312ad5761c9c43c5ab7f4530f41705dd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:23.416089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9184bee-2f87-4008-aad6-0ae9a6b973da None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.416379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9184bee-2f87-4008-aad6-0ae9a6b973da None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.416654 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9184bee-2f87-4008-aad6-0ae9a6b973da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.438001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c9184bee-2f87-4008-aad6-0ae9a6b973da None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:23.439291 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c9184bee-2f87-4008-aad6-0ae9a6b973da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:23.456832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:23.503587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1319/2645] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:41:23.511569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9327383-2a08-4a13-94f7-35c45e7a6a54 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.511856 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9327383-2a08-4a13-94f7-35c45e7a6a54 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.512135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9327383-2a08-4a13-94f7-35c45e7a6a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.532617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b9327383-2a08-4a13-94f7-35c45e7a6a54 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:23.533823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9327383-2a08-4a13-94f7-35c45e7a6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:23.541780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1327/2646] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:23.546563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9184bee-2f87-4008-aad6-0ae9a6b973da None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:23.556226 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9184bee-2f87-4008-aad6-0ae9a6b973da None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:23.560850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd74047-0425-486b-8b54-bb7c56f79c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:23.561442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd74047-0425-486b-8b54-bb7c56f79c73 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.561717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd74047-0425-486b-8b54-bb7c56f79c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.562004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd74047-0425-486b-8b54-bb7c56f79c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.562629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd74047-0425-486b-8b54-bb7c56f79c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:41:23.562963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd74047-0425-486b-8b54-bb7c56f79c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:23.564551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd74047-0425-486b-8b54-bb7c56f79c73 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:23.575802 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1320/2647] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:41:23.580063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9327383-2a08-4a13-94f7-35c45e7a6a54 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:23.589389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9327383-2a08-4a13-94f7-35c45e7a6a54 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:23.594625 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb276c-5977-49b5-9573-64f2b6d40bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:23.595248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb276c-5977-49b5-9573-64f2b6d40bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.595527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb276c-5977-49b5-9573-64f2b6d40bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.595799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb276c-5977-49b5-9573-64f2b6d40bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.596433 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb276c-5977-49b5-9573-64f2b6d40bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:23.598331 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb276c-5977-49b5-9573-64f2b6d40bbb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:23.625585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1328/2648] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:23 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:41:23.629775 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd74047-0425-486b-8b54-bb7c56f79c73 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:23.639892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd74047-0425-486b-8b54-bb7c56f79c73 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:23.701308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a22cb-e88a-4511-8518-eaa051f9c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:23.702023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a22cb-e88a-4511-8518-eaa051f9c7ed admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.702335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a22cb-e88a-4511-8518-eaa051f9c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.702619 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a22cb-e88a-4511-8518-eaa051f9c7ed admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.703328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a22cb-e88a-4511-8518-eaa051f9c7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:23.705250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a22cb-e88a-4511-8518-eaa051f9c7ed admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:23.732947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1321/2649] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:23 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:23.734574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb276c-5977-49b5-9573-64f2b6d40bbb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:23.745307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb276c-5977-49b5-9573-64f2b6d40bbb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:23.750376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafcc79-566f-451e-9c49-cb371ad1facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:23.751054 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafcc79-566f-451e-9c49-cb371ad1facf admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.751337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafcc79-566f-451e-9c49-cb371ad1facf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.751631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafcc79-566f-451e-9c49-cb371ad1facf admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.752262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafcc79-566f-451e-9c49-cb371ad1facf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:23.753881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafcc79-566f-451e-9c49-cb371ad1facf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:23.765017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1329/2650] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:23.769251 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a22cb-e88a-4511-8518-eaa051f9c7ed admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:23.780565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a22cb-e88a-4511-8518-eaa051f9c7ed admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:23.786994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf242b1-b1a6-4dc5-9b39-cab517071ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:23.787832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf242b1-b1a6-4dc5-9b39-cab517071ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.787953 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf242b1-b1a6-4dc5-9b39-cab517071ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.788144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf242b1-b1a6-4dc5-9b39-cab517071ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.788794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf242b1-b1a6-4dc5-9b39-cab517071ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:23.790407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf242b1-b1a6-4dc5-9b39-cab517071ac6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:23.803632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1322/2651] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:41:23.807975 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafcc79-566f-451e-9c49-cb371ad1facf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:23.819316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafcc79-566f-451e-9c49-cb371ad1facf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:23.826283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7374c87-cdef-4cd1-a902-4eecf44f9ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:23.827118 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7374c87-cdef-4cd1-a902-4eecf44f9ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.827305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7374c87-cdef-4cd1-a902-4eecf44f9ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.827541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7374c87-cdef-4cd1-a902-4eecf44f9ffb admin admin] PATH_INFO: `/v3/projects/bb76d7faa61943c1ae79cba44ad631e1/users/f3449c119e19463481340eaa7cf9f609/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.843926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7374c87-cdef-4cd1-a902-4eecf44f9ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb76d7faa61943c1ae79cba44ad631e1, user_id=f3449c119e19463481340eaa7cf9f609, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:23.846565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7374c87-cdef-4cd1-a902-4eecf44f9ffb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:23.870818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1330/2652] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:23 2022] PUT /identity/v3/projects/bb76d7faa61943c1ae79cba44ad631e1/users/f3449c119e19463481340eaa7cf9f609/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:23.872486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea08d1d-bed3-4faf-ad39-f5afb3ae277c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:23.872777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea08d1d-bed3-4faf-ad39-f5afb3ae277c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:23.873113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea08d1d-bed3-4faf-ad39-f5afb3ae277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:23.901641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1ea08d1d-bed3-4faf-ad39-f5afb3ae277c None None] MFA Rules not processed for user `f3449c119e19463481340eaa7cf9f609`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:23.902786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1ea08d1d-bed3-4faf-ad39-f5afb3ae277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:23.969391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1323/2653] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:23.981016 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7374c87-cdef-4cd1-a902-4eecf44f9ffb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:23.982935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d7374c87-cdef-4cd1-a902-4eecf44f9ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:24.006973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:24.046006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7374c87-cdef-4cd1-a902-4eecf44f9ffb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:24.050340 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daa64e-0f3e-4467-b7d5-2cc12b51692e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:24.050979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daa64e-0f3e-4467-b7d5-2cc12b51692e service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:24.051263 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daa64e-0f3e-4467-b7d5-2cc12b51692e service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:24.051539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daa64e-0f3e-4467-b7d5-2cc12b51692e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:24.060562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daa64e-0f3e-4467-b7d5-2cc12b51692e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:24.062006 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daa64e-0f3e-4467-b7d5-2cc12b51692e service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:24.070841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1331/2654] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:31.372593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea08d1d-bed3-4faf-ad39-f5afb3ae277c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:31.374156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1ea08d1d-bed3-4faf-ad39-f5afb3ae277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:31.394041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:31.431448 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea08d1d-bed3-4faf-ad39-f5afb3ae277c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:31.435109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:31.435663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:31.435936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:31.436203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:31.437885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:31.501360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:31.502822 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:31.512390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1324/2655] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:34.066877 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=17 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:34.429159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daa64e-0f3e-4467-b7d5-2cc12b51692e service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:34.430561 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-38daa64e-0f3e-4467-b7d5-2cc12b51692e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:34.511116 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:34.514127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:34.515183 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daa64e-0f3e-4467-b7d5-2cc12b51692e service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:34.522284 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b86d0-c994-4e2a-96a7-fc4b709273b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:34.523029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b86d0-c994-4e2a-96a7-fc4b709273b4 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:34.523381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b86d0-c994-4e2a-96a7-fc4b709273b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:34.523657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b86d0-c994-4e2a-96a7-fc4b709273b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:34.525661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-914b86d0-c994-4e2a-96a7-fc4b709273b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:34.527322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2fc7f-43df-4486-a127-6029137cbe7b service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:34.533808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:34.534428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:34.534741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:34.535034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] PATH_INFO: `/v3/users/09e1a58dc35c49d4b5cccd6d91b9ef47` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:34.536316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e1a58dc35c49d4b5cccd6d91b9ef47)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:34.538320 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:34.542036 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b86d0-c994-4e2a-96a7-fc4b709273b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:34.543779 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b86d0-c994-4e2a-96a7-fc4b709273b4 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:34.556743 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1332/2656] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:34.597588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e1a58dc35c49d4b5cccd6d91b9ef47'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.605994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e1a58dc35c49d4b5cccd6d91b9ef47'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.606834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e1a58dc35c49d4b5cccd6d91b9ef47'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.620771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e1a58dc35c49d4b5cccd6d91b9ef47'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.629129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5f6dcd4e-524b-46e9-a0e1-eb4608cc8444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e1a58dc35c49d4b5cccd6d91b9ef47'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.635310 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1325/2657] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:34 2022] DELETE /identity/v3/users/09e1a58dc35c49d4b5cccd6d91b9ef47 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:41:34.816746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b86d0-c994-4e2a-96a7-fc4b709273b4 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:34.829169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b86d0-c994-4e2a-96a7-fc4b709273b4 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:34.888196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:34.888832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:34.889114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:34.889381 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] PATH_INFO: `/v3/projects/09649d971871400ba9611cbfad32513b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:34.890600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09649d971871400ba9611cbfad32513b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:34.892606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:34.941090 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09649d971871400ba9611cbfad32513b', 'request_id': 'req-0ace882e-324a-483d-aa67-7cb46ca0fd61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.949995 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09649d971871400ba9611cbfad32513b', 'request_id': 'req-0ace882e-324a-483d-aa67-7cb46ca0fd61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.956773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09649d971871400ba9611cbfad32513b', 'request_id': 'req-0ace882e-324a-483d-aa67-7cb46ca0fd61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.969415 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] The token cache is being invalidate because project 09649d971871400ba9611cbfad32513b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:34.969702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.970346 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0ace882e-324a-483d-aa67-7cb46ca0fd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:34.971974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1333/2658] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:34 2022] DELETE /identity/v3/projects/09649d971871400ba9611cbfad32513b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:34.977118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfea3c-1030-49e1-b1e2-9a3ccce974a3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:34.977540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfea3c-1030-49e1-b1e2-9a3ccce974a3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:34.977883 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfea3c-1030-49e1-b1e2-9a3ccce974a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.000111 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-36dfea3c-1030-49e1-b1e2-9a3ccce974a3 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:35.001685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-36dfea3c-1030-49e1-b1e2-9a3ccce974a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:35.038956 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:35.066644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1326/2659] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:41:35.076633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f56f6-1925-4395-99ef-57c8bb03e1e6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.077268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f56f6-1925-4395-99ef-57c8bb03e1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.077268 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f56f6-1925-4395-99ef-57c8bb03e1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.098468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-662f56f6-1925-4395-99ef-57c8bb03e1e6 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:35.099678 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-662f56f6-1925-4395-99ef-57c8bb03e1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:35.108826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1334/2660] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:35.113560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfea3c-1030-49e1-b1e2-9a3ccce974a3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:35.124722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfea3c-1030-49e1-b1e2-9a3ccce974a3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:35.129407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db447-6dfd-49b0-b98e-f9dd792610c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:35.130007 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db447-6dfd-49b0-b98e-f9dd792610c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.130285 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db447-6dfd-49b0-b98e-f9dd792610c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.130555 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db447-6dfd-49b0-b98e-f9dd792610c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.131233 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171db447-6dfd-49b0-b98e-f9dd792610c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:41:35.131538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171db447-6dfd-49b0-b98e-f9dd792610c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:35.133130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171db447-6dfd-49b0-b98e-f9dd792610c4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:35.145656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1327/2661] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:41:35.150524 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f56f6-1925-4395-99ef-57c8bb03e1e6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:35.160417 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f56f6-1925-4395-99ef-57c8bb03e1e6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:35.165489 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a9e09-eb13-4c4c-83f0-a9e5c7ef8d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:35.166091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a9e09-eb13-4c4c-83f0-a9e5c7ef8d69 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.166373 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a9e09-eb13-4c4c-83f0-a9e5c7ef8d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.166753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a9e09-eb13-4c4c-83f0-a9e5c7ef8d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.167383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a9e09-eb13-4c4c-83f0-a9e5c7ef8d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:35.169805 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a9e09-eb13-4c4c-83f0-a9e5c7ef8d69 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:35.181644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:35.198286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1335/2662] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:35 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:35.202632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db447-6dfd-49b0-b98e-f9dd792610c4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:35.215390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db447-6dfd-49b0-b98e-f9dd792610c4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:35.275198 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb27db-9214-47f9-9a1a-7b891c68c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:35.275804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb27db-9214-47f9-9a1a-7b891c68c984 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.276184 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb27db-9214-47f9-9a1a-7b891c68c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.276788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb27db-9214-47f9-9a1a-7b891c68c984 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.277447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb27db-9214-47f9-9a1a-7b891c68c984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:35.279445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb27db-9214-47f9-9a1a-7b891c68c984 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:35.300941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1328/2663] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:35 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:41:35.304835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a9e09-eb13-4c4c-83f0-a9e5c7ef8d69 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:35.315602 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a9e09-eb13-4c4c-83f0-a9e5c7ef8d69 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:35.320431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c210fd-b9a0-435c-9cb1-5a4c9ff4ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:35.321041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c210fd-b9a0-435c-9cb1-5a4c9ff4ccff admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.321320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c210fd-b9a0-435c-9cb1-5a4c9ff4ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.321591 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c210fd-b9a0-435c-9cb1-5a4c9ff4ccff admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.322232 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c210fd-b9a0-435c-9cb1-5a4c9ff4ccff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:35.323889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c210fd-b9a0-435c-9cb1-5a4c9ff4ccff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:35.333998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1336/2664] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:35.338401 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb27db-9214-47f9-9a1a-7b891c68c984 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:35.348462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb27db-9214-47f9-9a1a-7b891c68c984 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:35.353657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46c069-7054-4465-b316-c40646e4363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:35.354253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46c069-7054-4465-b316-c40646e4363c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.354532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46c069-7054-4465-b316-c40646e4363c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.354848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46c069-7054-4465-b316-c40646e4363c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.355486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46c069-7054-4465-b316-c40646e4363c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:35.357612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46c069-7054-4465-b316-c40646e4363c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:35.368022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1329/2665] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:35.373095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c210fd-b9a0-435c-9cb1-5a4c9ff4ccff admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:35.383240 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c210fd-b9a0-435c-9cb1-5a4c9ff4ccff admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:35.387768 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5830ef-7c27-494e-b2f6-256d8bd9726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:35.388410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5830ef-7c27-494e-b2f6-256d8bd9726f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.388683 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5830ef-7c27-494e-b2f6-256d8bd9726f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.388959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5830ef-7c27-494e-b2f6-256d8bd9726f admin admin] PATH_INFO: `/v3/projects/b4d14fc1b7074a758b176a68f5bc8003/users/d4e50b8b72ec4dbbabcc264b7126ea4f/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.403192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5830ef-7c27-494e-b2f6-256d8bd9726f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d14fc1b7074a758b176a68f5bc8003, user_id=d4e50b8b72ec4dbbabcc264b7126ea4f, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:35.405936 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5830ef-7c27-494e-b2f6-256d8bd9726f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:35.418697 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1337/2666] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:35 2022] PUT /identity/v3/projects/b4d14fc1b7074a758b176a68f5bc8003/users/d4e50b8b72ec4dbbabcc264b7126ea4f/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:35.429279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a229155-8ca5-42a9-8ace-fda64f46a5f2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.429570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a229155-8ca5-42a9-8ace-fda64f46a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.429843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a229155-8ca5-42a9-8ace-fda64f46a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.457309 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3a229155-8ca5-42a9-8ace-fda64f46a5f2 None None] MFA Rules not processed for user `d4e50b8b72ec4dbbabcc264b7126ea4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:35.458451 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3a229155-8ca5-42a9-8ace-fda64f46a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:35.521453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1330/2667] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:35.533083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5830ef-7c27-494e-b2f6-256d8bd9726f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:35.534828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dc5830ef-7c27-494e-b2f6-256d8bd9726f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:35.610091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5830ef-7c27-494e-b2f6-256d8bd9726f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:35.615643 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41e99-d2d0-4f12-ab70-c73d874e9b17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76462c2e1ec447acbd2aba9e77ae00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:35.616266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41e99-d2d0-4f12-ab70-c73d874e9b17 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.616542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41e99-d2d0-4f12-ab70-c73d874e9b17 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.616816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41e99-d2d0-4f12-ab70-c73d874e9b17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.626040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea41e99-d2d0-4f12-ab70-c73d874e9b17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:35.627772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea41e99-d2d0-4f12-ab70-c73d874e9b17 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:35.636795 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1338/2668] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:35.850969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a229155-8ca5-42a9-8ace-fda64f46a5f2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:35.890190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:35.914620 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a229155-8ca5-42a9-8ace-fda64f46a5f2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:35.919090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:35.919695 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:35.919970 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:35.920240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] PATH_INFO: `/v3/users/d4e50b8b72ec4dbbabcc264b7126ea4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:35.921372 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e50b8b72ec4dbbabcc264b7126ea4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:35.923360 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:35.968742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e50b8b72ec4dbbabcc264b7126ea4f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:35.975924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e50b8b72ec4dbbabcc264b7126ea4f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:35.976542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e50b8b72ec4dbbabcc264b7126ea4f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:35.988458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e50b8b72ec4dbbabcc264b7126ea4f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:35.995520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e50b8b72ec4dbbabcc264b7126ea4f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:36.001330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1331/2669] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:35 2022] DELETE /identity/v3/users/d4e50b8b72ec4dbbabcc264b7126ea4f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:36.005801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed5065-f588-4a8a-bdb0-a05d22613ce6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.006090 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed5065-f588-4a8a-bdb0-a05d22613ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.006396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed5065-f588-4a8a-bdb0-a05d22613ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.027558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-57ed5065-f588-4a8a-bdb0-a05d22613ce6 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:36.029460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-57ed5065-f588-4a8a-bdb0-a05d22613ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:36.093543 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1339/2670] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:36.103763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:36.105301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:36.173674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a11576-8a3e-4311-918e-3b30d8180072 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:36.177445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eca8d-1843-4214-a51e-2c9a5ab6f66c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:36.178050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eca8d-1843-4214-a51e-2c9a5ab6f66c service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.178334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eca8d-1843-4214-a51e-2c9a5ab6f66c service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.178609 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eca8d-1843-4214-a51e-2c9a5ab6f66c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.188001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216eca8d-1843-4214-a51e-2c9a5ab6f66c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:36.189424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216eca8d-1843-4214-a51e-2c9a5ab6f66c service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:36.198771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1332/2671] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:41:36.491569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed5065-f588-4a8a-bdb0-a05d22613ce6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:36.493395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-57ed5065-f588-4a8a-bdb0-a05d22613ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:36.506382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed5065-f588-4a8a-bdb0-a05d22613ce6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:36.511506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:36.512145 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.512423 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.512727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] PATH_INFO: `/v3/projects/b4d14fc1b7074a758b176a68f5bc8003` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.513998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d14fc1b7074a758b176a68f5bc8003)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:36.515978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:36.557847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:36.568316 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d14fc1b7074a758b176a68f5bc8003', 'request_id': 'req-2f929c76-da9c-4b4f-933d-e94ed2c88872'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:36.576810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d14fc1b7074a758b176a68f5bc8003', 'request_id': 'req-2f929c76-da9c-4b4f-933d-e94ed2c88872'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:36.582558 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d14fc1b7074a758b176a68f5bc8003', 'request_id': 'req-2f929c76-da9c-4b4f-933d-e94ed2c88872'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:36.594047 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] The token cache is being invalidate because project b4d14fc1b7074a758b176a68f5bc8003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:36.594337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:36.594986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f929c76-da9c-4b4f-933d-e94ed2c88872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:36.596488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1340/2672] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:36 2022] DELETE /identity/v3/projects/b4d14fc1b7074a758b176a68f5bc8003 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:36.601554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadaa1e-c0ff-42d3-8b3d-4fea6e525be1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.602028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadaa1e-c0ff-42d3-8b3d-4fea6e525be1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.602127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadaa1e-c0ff-42d3-8b3d-4fea6e525be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.624085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6dadaa1e-c0ff-42d3-8b3d-4fea6e525be1 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:36.625307 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6dadaa1e-c0ff-42d3-8b3d-4fea6e525be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:36.678840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:36.703254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1333/2673] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:36.704780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f8665-f4d1-4240-b7da-d5e802c2db92 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.705070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f8665-f4d1-4240-b7da-d5e802c2db92 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.705350 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f8665-f4d1-4240-b7da-d5e802c2db92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.725971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6c6f8665-f4d1-4240-b7da-d5e802c2db92 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:36.727220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6c6f8665-f4d1-4240-b7da-d5e802c2db92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:36.735302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1341/2674] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:41:36.739406 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadaa1e-c0ff-42d3-8b3d-4fea6e525be1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:36.749803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadaa1e-c0ff-42d3-8b3d-4fea6e525be1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:36.754402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae46c3-cfc9-4296-add9-608a1cdd6d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:36.755034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae46c3-cfc9-4296-add9-608a1cdd6d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.755315 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae46c3-cfc9-4296-add9-608a1cdd6d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.755583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae46c3-cfc9-4296-add9-608a1cdd6d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.756225 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae46c3-cfc9-4296-add9-608a1cdd6d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:41:36.756525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae46c3-cfc9-4296-add9-608a1cdd6d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:36.758119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae46c3-cfc9-4296-add9-608a1cdd6d88 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:36.774345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1334/2675] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:41:36.775484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f8665-f4d1-4240-b7da-d5e802c2db92 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:36.785603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f8665-f4d1-4240-b7da-d5e802c2db92 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:36.790377 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330724d-1c3b-4a2b-a3cd-afa9938bd037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:36.791030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330724d-1c3b-4a2b-a3cd-afa9938bd037 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.791311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330724d-1c3b-4a2b-a3cd-afa9938bd037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.791604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330724d-1c3b-4a2b-a3cd-afa9938bd037 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.792244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330724d-1c3b-4a2b-a3cd-afa9938bd037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:36.794352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330724d-1c3b-4a2b-a3cd-afa9938bd037 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:36.826527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1342/2676] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:36 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:41:36.830760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae46c3-cfc9-4296-add9-608a1cdd6d88 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:36.841710 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae46c3-cfc9-4296-add9-608a1cdd6d88 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:36.904235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443c45f-d529-4a76-9c0f-4df600b6eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:36.904837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443c45f-d529-4a76-9c0f-4df600b6eab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.905117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443c45f-d529-4a76-9c0f-4df600b6eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.905395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443c45f-d529-4a76-9c0f-4df600b6eab3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.906025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443c45f-d529-4a76-9c0f-4df600b6eab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:36.908044 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443c45f-d529-4a76-9c0f-4df600b6eab3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:36.930488 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1335/2677] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:36 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:36.934943 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330724d-1c3b-4a2b-a3cd-afa9938bd037 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:36.946545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330724d-1c3b-4a2b-a3cd-afa9938bd037 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:36.951832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df666-9114-4468-bd85-b02a2d87015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:36.952446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df666-9114-4468-bd85-b02a2d87015c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.952719 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df666-9114-4468-bd85-b02a2d87015c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.952986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df666-9114-4468-bd85-b02a2d87015c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.953665 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df666-9114-4468-bd85-b02a2d87015c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:36.955310 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df666-9114-4468-bd85-b02a2d87015c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:36.967045 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1343/2678] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:36.971204 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443c45f-d529-4a76-9c0f-4df600b6eab3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:36.981330 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443c45f-d529-4a76-9c0f-4df600b6eab3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:36.986090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7b35f-ba3d-4651-a28f-0d7990544943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:36.986636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7b35f-ba3d-4651-a28f-0d7990544943 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:36.986938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7b35f-ba3d-4651-a28f-0d7990544943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:36.987208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7b35f-ba3d-4651-a28f-0d7990544943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:36.987843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7b35f-ba3d-4651-a28f-0d7990544943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:36.989428 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7b35f-ba3d-4651-a28f-0d7990544943 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:37.000046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1336/2679] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:37.004236 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df666-9114-4468-bd85-b02a2d87015c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:37.014923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df666-9114-4468-bd85-b02a2d87015c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:37.019521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bc01e-bdb3-4266-a3fc-34adb4e76938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:37.020170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bc01e-bdb3-4266-a3fc-34adb4e76938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:37.020453 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bc01e-bdb3-4266-a3fc-34adb4e76938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:37.020733 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bc01e-bdb3-4266-a3fc-34adb4e76938 admin admin] PATH_INFO: `/v3/projects/9e5b9e80ee2249de8531cb0f0f560982/users/e0603a813cb048ee911646399dd5b367/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:37.036304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bc01e-bdb3-4266-a3fc-34adb4e76938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5b9e80ee2249de8531cb0f0f560982, user_id=e0603a813cb048ee911646399dd5b367, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:37.039031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bc01e-bdb3-4266-a3fc-34adb4e76938 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:37.051979 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1344/2680] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:37 2022] PUT /identity/v3/projects/9e5b9e80ee2249de8531cb0f0f560982/users/e0603a813cb048ee911646399dd5b367/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:37.066318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b0be-0e3e-45c9-881c-7dcfc8384c23 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:37.066623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b0be-0e3e-45c9-881c-7dcfc8384c23 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:37.067015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b0be-0e3e-45c9-881c-7dcfc8384c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:37.095921 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6295b0be-0e3e-45c9-881c-7dcfc8384c23 None None] MFA Rules not processed for user `e0603a813cb048ee911646399dd5b367`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:37.097120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6295b0be-0e3e-45c9-881c-7dcfc8384c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:37.162269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1337/2681] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:41:37.166982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bc01e-bdb3-4266-a3fc-34adb4e76938 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:37.228542 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bc01e-bdb3-4266-a3fc-34adb4e76938 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:37.233374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2c3c-fa78-4999-8d15-c74a6753ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:37.233972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2c3c-fa78-4999-8d15-c74a6753ba65 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:37.234249 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2c3c-fa78-4999-8d15-c74a6753ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:37.234519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2c3c-fa78-4999-8d15-c74a6753ba65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:37.235177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2c3c-fa78-4999-8d15-c74a6753ba65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:37.237110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2c3c-fa78-4999-8d15-c74a6753ba65 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:37.264025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1345/2682] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:37 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:37.268132 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b0be-0e3e-45c9-881c-7dcfc8384c23 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:37.279238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b0be-0e3e-45c9-881c-7dcfc8384c23 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:37.449182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:37.459413 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98d303-d03b-4db5-b424-b8a143370520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:37.460013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98d303-d03b-4db5-b424-b8a143370520 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:37.460288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98d303-d03b-4db5-b424-b8a143370520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:37.460550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98d303-d03b-4db5-b424-b8a143370520 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:37.461181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98d303-d03b-4db5-b424-b8a143370520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:37.463109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98d303-d03b-4db5-b424-b8a143370520 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:37.486963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1338/2683] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:37 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:41:37.491076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2c3c-fa78-4999-8d15-c74a6753ba65 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:37.502826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2c3c-fa78-4999-8d15-c74a6753ba65 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:37.507525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a58e12-0931-4d1a-a82b-87740b5c0acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:37.508132 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a58e12-0931-4d1a-a82b-87740b5c0acf admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:37.508413 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a58e12-0931-4d1a-a82b-87740b5c0acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:37.508684 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a58e12-0931-4d1a-a82b-87740b5c0acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:37.509324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a58e12-0931-4d1a-a82b-87740b5c0acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:37.510968 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a58e12-0931-4d1a-a82b-87740b5c0acf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:37.645749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1346/2684] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:37.650023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98d303-d03b-4db5-b424-b8a143370520 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:37.660090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98d303-d03b-4db5-b424-b8a143370520 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:37.664683 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083d1c-7569-4290-b15f-616a88fb3bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:37.665321 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083d1c-7569-4290-b15f-616a88fb3bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:37.665595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083d1c-7569-4290-b15f-616a88fb3bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:37.665862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083d1c-7569-4290-b15f-616a88fb3bd6 admin admin] PATH_INFO: `/v3/projects/d372e9a1f8754da38f32353553d31e10/users/1302ec30d1fb4dcca1fff5a1c54cfc99/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:37.683008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083d1c-7569-4290-b15f-616a88fb3bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d372e9a1f8754da38f32353553d31e10, user_id=1302ec30d1fb4dcca1fff5a1c54cfc99, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:37.687076 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083d1c-7569-4290-b15f-616a88fb3bd6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:37.704290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1339/2685] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:37 2022] PUT /identity/v3/projects/d372e9a1f8754da38f32353553d31e10/users/1302ec30d1fb4dcca1fff5a1c54cfc99/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:37.708646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a58e12-0931-4d1a-a82b-87740b5c0acf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:37.719128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a58e12-0931-4d1a-a82b-87740b5c0acf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:37.751928 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:37.780069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb821923-0fc0-4e47-9d5f-60e40fe8cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:37.780671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb821923-0fc0-4e47-9d5f-60e40fe8cbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:37.780953 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb821923-0fc0-4e47-9d5f-60e40fe8cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:37.781229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb821923-0fc0-4e47-9d5f-60e40fe8cbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:37.781864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb821923-0fc0-4e47-9d5f-60e40fe8cbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:37.783576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb821923-0fc0-4e47-9d5f-60e40fe8cbc8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:37.793173 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1347/2686] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:37.798492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083d1c-7569-4290-b15f-616a88fb3bd6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:37.808462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083d1c-7569-4290-b15f-616a88fb3bd6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:37.813863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d1a3c-2c28-403d-a68c-27d2793ad6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:37.814503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1a3c-2c28-403d-a68c-27d2793ad6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:37.814798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1a3c-2c28-403d-a68c-27d2793ad6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:37.815065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1a3c-2c28-403d-a68c-27d2793ad6fc admin admin] PATH_INFO: `/v3/projects/d372e9a1f8754da38f32353553d31e10/users/1302ec30d1fb4dcca1fff5a1c54cfc99/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:37.816977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d1a3c-2c28-403d-a68c-27d2793ad6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d372e9a1f8754da38f32353553d31e10, user_id=1302ec30d1fb4dcca1fff5a1c54cfc99, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:37.819627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d1a3c-2c28-403d-a68c-27d2793ad6fc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:37.829807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1340/2687] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:37 2022] PUT /identity/v3/projects/d372e9a1f8754da38f32353553d31e10/users/1302ec30d1fb4dcca1fff5a1c54cfc99/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:37.841873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599592a-ab1d-418f-95bf-ee1444f8251c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:37.841873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599592a-ab1d-418f-95bf-ee1444f8251c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:37.842163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599592a-ab1d-418f-95bf-ee1444f8251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:37.870142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a599592a-ab1d-418f-95bf-ee1444f8251c None None] MFA Rules not processed for user `1302ec30d1fb4dcca1fff5a1c54cfc99`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:37.871359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a599592a-ab1d-418f-95bf-ee1444f8251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:37.935941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1348/2688] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:37.947121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d1a3c-2c28-403d-a68c-27d2793ad6fc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:37.948806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-643d1a3c-2c28-403d-a68c-27d2793ad6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:38.008264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d1a3c-2c28-403d-a68c-27d2793ad6fc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:38.012261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5a118-d252-4c89-8507-e3542ca4b94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:38.013042 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5a118-d252-4c89-8507-e3542ca4b94f service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:38.013322 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5a118-d252-4c89-8507-e3542ca4b94f service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:38.013618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5a118-d252-4c89-8507-e3542ca4b94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:38.024045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5a118-d252-4c89-8507-e3542ca4b94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:38.025489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5a118-d252-4c89-8507-e3542ca4b94f service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:38.037344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1341/2689] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:38.111206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599592a-ab1d-418f-95bf-ee1444f8251c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:38.122050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599592a-ab1d-418f-95bf-ee1444f8251c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:38.126272 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff29d-ffe4-49b5-bc91-7f45a1f2525d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:38.126923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff29d-ffe4-49b5-bc91-7f45a1f2525d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:38.127197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff29d-ffe4-49b5-bc91-7f45a1f2525d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:38.127463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff29d-ffe4-49b5-bc91-7f45a1f2525d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:38.185061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff29d-ffe4-49b5-bc91-7f45a1f2525d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:38.186491 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff29d-ffe4-49b5-bc91-7f45a1f2525d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:38.195163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1349/2690] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:40.927704 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5a118-d252-4c89-8507-e3542ca4b94f service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:40.996521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5a118-d252-4c89-8507-e3542ca4b94f service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:41.001270 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:41.001892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:41.002170 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:41.002439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] PATH_INFO: `/v3/users/e0603a813cb048ee911646399dd5b367` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:41.003591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0603a813cb048ee911646399dd5b367)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:41.005499 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:41.050980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0603a813cb048ee911646399dd5b367'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.053359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:41.058643 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0603a813cb048ee911646399dd5b367'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.059377 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0603a813cb048ee911646399dd5b367'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.072412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0603a813cb048ee911646399dd5b367'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.079292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0603a813cb048ee911646399dd5b367'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.085118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1342/2691] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:40 2022] DELETE /identity/v3/users/e0603a813cb048ee911646399dd5b367 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:41.089578 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150ff58-6581-4e56-b083-d134003e6c70 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:41.090044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150ff58-6581-4e56-b083-d134003e6c70 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:41.090141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150ff58-6581-4e56-b083-d134003e6c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:41.109406 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5150ff58-6581-4e56-b083-d134003e6c70 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:41.110588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5150ff58-6581-4e56-b083-d134003e6c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:41.160956 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:41.173167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1350/2692] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:41.183008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:41.184429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:41.256039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc03a-7021-426d-a9aa-aed03f52740f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:41.259708 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902d49d-d1da-4be1-a102-11e57b5a2914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:41.260302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d49d-d1da-4be1-a102-11e57b5a2914 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:41.260583 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d49d-d1da-4be1-a102-11e57b5a2914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:41.260858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d49d-d1da-4be1-a102-11e57b5a2914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:41.270433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902d49d-d1da-4be1-a102-11e57b5a2914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:41.271885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902d49d-d1da-4be1-a102-11e57b5a2914 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:41.281817 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1343/2693] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:41.562468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150ff58-6581-4e56-b083-d134003e6c70 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:41.566819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5150ff58-6581-4e56-b083-d134003e6c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:41.579363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150ff58-6581-4e56-b083-d134003e6c70 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:41.584288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:41.584934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:41.585338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:41.585506 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] PATH_INFO: `/v3/projects/9e5b9e80ee2249de8531cb0f0f560982` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:41.586646 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5b9e80ee2249de8531cb0f0f560982)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:41.588722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:41.636229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5b9e80ee2249de8531cb0f0f560982', 'request_id': 'req-a2514e2f-9d3c-4b92-8c38-822110ea6625'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.644283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5b9e80ee2249de8531cb0f0f560982', 'request_id': 'req-a2514e2f-9d3c-4b92-8c38-822110ea6625'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.650053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5b9e80ee2249de8531cb0f0f560982', 'request_id': 'req-a2514e2f-9d3c-4b92-8c38-822110ea6625'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.664015 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] The token cache is being invalidate because project 9e5b9e80ee2249de8531cb0f0f560982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:41.664320 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.664992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.666832 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1351/2694] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:41 2022] DELETE /identity/v3/projects/9e5b9e80ee2249de8531cb0f0f560982 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:41.671850 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902d49d-d1da-4be1-a102-11e57b5a2914 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:41.682519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902d49d-d1da-4be1-a102-11e57b5a2914 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:41.742938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:41.743834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:41.744108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:41.744407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] PATH_INFO: `/v3/users/1302ec30d1fb4dcca1fff5a1c54cfc99` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:41.745561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1302ec30d1fb4dcca1fff5a1c54cfc99)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:41.748081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:41.793572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1302ec30d1fb4dcca1fff5a1c54cfc99'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.800604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1302ec30d1fb4dcca1fff5a1c54cfc99'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.801233 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1302ec30d1fb4dcca1fff5a1c54cfc99'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.813589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1302ec30d1fb4dcca1fff5a1c54cfc99'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.814771 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:41.821768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c46b853a-c3d0-4792-aa4e-e664e7ad27d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1302ec30d1fb4dcca1fff5a1c54cfc99'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:41.828854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1344/2695] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:41 2022] DELETE /identity/v3/users/1302ec30d1fb4dcca1fff5a1c54cfc99 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:42.110254 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:42.111775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:42.127780 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514e2f-9d3c-4b92-8c38-822110ea6625 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:42.185319 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:42.185946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.186221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.186486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] PATH_INFO: `/v3/projects/d372e9a1f8754da38f32353553d31e10` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.187639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d372e9a1f8754da38f32353553d31e10)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:42.189541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:42.237258 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd372e9a1f8754da38f32353553d31e10', 'request_id': 'req-b2807543-5fd7-4a35-ba6a-026de3adb31b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:42.244772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd372e9a1f8754da38f32353553d31e10', 'request_id': 'req-b2807543-5fd7-4a35-ba6a-026de3adb31b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:42.251102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd372e9a1f8754da38f32353553d31e10', 'request_id': 'req-b2807543-5fd7-4a35-ba6a-026de3adb31b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:42.261783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] The token cache is being invalidate because project d372e9a1f8754da38f32353553d31e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:42.262069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:42.262834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b2807543-5fd7-4a35-ba6a-026de3adb31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:42.264343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1352/2696] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:42 2022] DELETE /identity/v3/projects/d372e9a1f8754da38f32353553d31e10 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:41:42.269945 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4c5bf-77b3-4011-8bca-dd4572c5ef83 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.270459 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4c5bf-77b3-4011-8bca-dd4572c5ef83 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.270562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4c5bf-77b3-4011-8bca-dd4572c5ef83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.290179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6df4c5bf-77b3-4011-8bca-dd4572c5ef83 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:42.291404 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6df4c5bf-77b3-4011-8bca-dd4572c5ef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:42.349748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1345/2697] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:42.359891 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849d0d5-a469-4d1b-aa05-6c23a42ec493 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.360206 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849d0d5-a469-4d1b-aa05-6c23a42ec493 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.360486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849d0d5-a469-4d1b-aa05-6c23a42ec493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.380349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0849d0d5-a469-4d1b-aa05-6c23a42ec493 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:42.381547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0849d0d5-a469-4d1b-aa05-6c23a42ec493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:42.389523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1353/2698] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:42.393698 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4c5bf-77b3-4011-8bca-dd4572c5ef83 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:42.403803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4c5bf-77b3-4011-8bca-dd4572c5ef83 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:42.408319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701238a0-ed12-416b-beda-6a5cf9c7b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:42.408902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701238a0-ed12-416b-beda-6a5cf9c7b99c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.409176 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701238a0-ed12-416b-beda-6a5cf9c7b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.409441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701238a0-ed12-416b-beda-6a5cf9c7b99c admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.410072 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701238a0-ed12-416b-beda-6a5cf9c7b99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:41:42.410368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701238a0-ed12-416b-beda-6a5cf9c7b99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:42.411978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701238a0-ed12-416b-beda-6a5cf9c7b99c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:42.423875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1346/2699] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:41:42.428223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849d0d5-a469-4d1b-aa05-6c23a42ec493 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:42.432676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:42.439557 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849d0d5-a469-4d1b-aa05-6c23a42ec493 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:42.446127 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707b979-aee2-4441-97e8-bd3345d02f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:42.447017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707b979-aee2-4441-97e8-bd3345d02f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.447301 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707b979-aee2-4441-97e8-bd3345d02f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.447715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707b979-aee2-4441-97e8-bd3345d02f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.448588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707b979-aee2-4441-97e8-bd3345d02f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:42.450897 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707b979-aee2-4441-97e8-bd3345d02f03 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:42.485519 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1354/2700] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:42 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:42.487425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701238a0-ed12-416b-beda-6a5cf9c7b99c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:42.497453 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701238a0-ed12-416b-beda-6a5cf9c7b99c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:42.552969 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77312b-c242-415d-b296-b97784e831cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:42.553569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77312b-c242-415d-b296-b97784e831cd admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.553851 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77312b-c242-415d-b296-b97784e831cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.554114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77312b-c242-415d-b296-b97784e831cd admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.554776 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77312b-c242-415d-b296-b97784e831cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:42.556663 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77312b-c242-415d-b296-b97784e831cd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:42.577027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1347/2701] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:42 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:42.581362 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707b979-aee2-4441-97e8-bd3345d02f03 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:42.592267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707b979-aee2-4441-97e8-bd3345d02f03 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:42.596907 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdfbee-1e4b-4932-a4c7-42d164cc5af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:42.597507 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdfbee-1e4b-4932-a4c7-42d164cc5af3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.597782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdfbee-1e4b-4932-a4c7-42d164cc5af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.598050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdfbee-1e4b-4932-a4c7-42d164cc5af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.598705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdfbee-1e4b-4932-a4c7-42d164cc5af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:42.600435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdfbee-1e4b-4932-a4c7-42d164cc5af3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:42.610988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1355/2702] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:42.614853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77312b-c242-415d-b296-b97784e831cd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:42.624860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77312b-c242-415d-b296-b97784e831cd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:42.629394 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a1315-6a90-4c5f-811e-6ec6156f15a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:42.629980 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a1315-6a90-4c5f-811e-6ec6156f15a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.630260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a1315-6a90-4c5f-811e-6ec6156f15a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.630530 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a1315-6a90-4c5f-811e-6ec6156f15a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.631191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a1315-6a90-4c5f-811e-6ec6156f15a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:42.632767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a1315-6a90-4c5f-811e-6ec6156f15a7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:42.643659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1348/2703] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:42.647681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdfbee-1e4b-4932-a4c7-42d164cc5af3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:42.658463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdfbee-1e4b-4932-a4c7-42d164cc5af3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:42.663017 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17120547-e80c-4158-83f5-a1b3b1dab014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:42.663648 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17120547-e80c-4158-83f5-a1b3b1dab014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.663923 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17120547-e80c-4158-83f5-a1b3b1dab014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.664189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17120547-e80c-4158-83f5-a1b3b1dab014 admin admin] PATH_INFO: `/v3/projects/86335f3e87824b55a5bc7d26e74afd00/users/aa4b64d424184a77993e36ed2ced7ea1/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.682532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17120547-e80c-4158-83f5-a1b3b1dab014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86335f3e87824b55a5bc7d26e74afd00, user_id=aa4b64d424184a77993e36ed2ced7ea1, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:42.685215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17120547-e80c-4158-83f5-a1b3b1dab014 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:42.698097 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1356/2704] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:42 2022] PUT /identity/v3/projects/86335f3e87824b55a5bc7d26e74afd00/users/aa4b64d424184a77993e36ed2ced7ea1/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:42.709082 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c9ba5-1e54-453c-955f-ab1b5600b8c4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.709368 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c9ba5-1e54-453c-955f-ab1b5600b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.709640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c9ba5-1e54-453c-955f-ab1b5600b8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.739060 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-314c9ba5-1e54-453c-955f-ab1b5600b8c4 None None] MFA Rules not processed for user `aa4b64d424184a77993e36ed2ced7ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:42.740181 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-314c9ba5-1e54-453c-955f-ab1b5600b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:42.785779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:42.811684 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1349/2705] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:41:42.818718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17120547-e80c-4158-83f5-a1b3b1dab014 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:42.881825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17120547-e80c-4158-83f5-a1b3b1dab014 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:42.886477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ea4a8-208f-43c9-bcb1-e0560e0a3102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:42.887095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ea4a8-208f-43c9-bcb1-e0560e0a3102 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.887369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ea4a8-208f-43c9-bcb1-e0560e0a3102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.888651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ea4a8-208f-43c9-bcb1-e0560e0a3102 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.889279 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ea4a8-208f-43c9-bcb1-e0560e0a3102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:42.891219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ea4a8-208f-43c9-bcb1-e0560e0a3102 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:42.917889 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1357/2706] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:42 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:42.923179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c9ba5-1e54-453c-955f-ab1b5600b8c4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:42.935156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c9ba5-1e54-453c-955f-ab1b5600b8c4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:42.990237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb8c4c-d569-4092-b04c-be02be730fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:42.990796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb8c4c-d569-4092-b04c-be02be730fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:42.991075 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb8c4c-d569-4092-b04c-be02be730fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:42.991389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb8c4c-d569-4092-b04c-be02be730fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:42.992022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb8c4c-d569-4092-b04c-be02be730fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:42.994278 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb8c4c-d569-4092-b04c-be02be730fa9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:43.017243 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1350/2707] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:42 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:41:43.021509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ea4a8-208f-43c9-bcb1-e0560e0a3102 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:43.032751 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ea4a8-208f-43c9-bcb1-e0560e0a3102 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:43.037582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3327e87-3a80-4e8d-871e-5896dbe91308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:43.038185 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3327e87-3a80-4e8d-871e-5896dbe91308 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:43.038461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3327e87-3a80-4e8d-871e-5896dbe91308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:43.038758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3327e87-3a80-4e8d-871e-5896dbe91308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:43.039403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3327e87-3a80-4e8d-871e-5896dbe91308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:43.041005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3327e87-3a80-4e8d-871e-5896dbe91308 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:43.052533 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1358/2708] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:43.057191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb8c4c-d569-4092-b04c-be02be730fa9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:43.069770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb8c4c-d569-4092-b04c-be02be730fa9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:43.074427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4658-2c1a-4355-a304-139777aafbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:43.075703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4658-2c1a-4355-a304-139777aafbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:43.075990 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4658-2c1a-4355-a304-139777aafbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:43.076264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4658-2c1a-4355-a304-139777aafbbf admin admin] PATH_INFO: `/v3/projects/efcca8e56e094adb920e0e0b59a8a122/users/5d7ce6f6a0044d46bd78fa61aa0d1940/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:43.091214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b4658-2c1a-4355-a304-139777aafbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcca8e56e094adb920e0e0b59a8a122, user_id=5d7ce6f6a0044d46bd78fa61aa0d1940, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:43.093885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b4658-2c1a-4355-a304-139777aafbbf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:43.107261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1351/2709] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:43 2022] PUT /identity/v3/projects/efcca8e56e094adb920e0e0b59a8a122/users/5d7ce6f6a0044d46bd78fa61aa0d1940/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:43.111428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3327e87-3a80-4e8d-871e-5896dbe91308 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:43.121695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3327e87-3a80-4e8d-871e-5896dbe91308 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:43.183550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f928c-ceae-4f00-8b8e-f8dbd52d0b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:43.184201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f928c-ceae-4f00-8b8e-f8dbd52d0b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:43.185010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f928c-ceae-4f00-8b8e-f8dbd52d0b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:43.185296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f928c-ceae-4f00-8b8e-f8dbd52d0b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:43.185957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f928c-ceae-4f00-8b8e-f8dbd52d0b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:43.187639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f928c-ceae-4f00-8b8e-f8dbd52d0b48 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:43.199544 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1359/2710] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:43.204361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4658-2c1a-4355-a304-139777aafbbf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:43.216357 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4658-2c1a-4355-a304-139777aafbbf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:43.221369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57c147-73e3-45a0-b6d3-30eb2bc483f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:43.222024 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57c147-73e3-45a0-b6d3-30eb2bc483f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:43.222301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57c147-73e3-45a0-b6d3-30eb2bc483f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:43.222870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57c147-73e3-45a0-b6d3-30eb2bc483f7 admin admin] PATH_INFO: `/v3/projects/efcca8e56e094adb920e0e0b59a8a122/users/5d7ce6f6a0044d46bd78fa61aa0d1940/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:43.224909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57c147-73e3-45a0-b6d3-30eb2bc483f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcca8e56e094adb920e0e0b59a8a122, user_id=5d7ce6f6a0044d46bd78fa61aa0d1940, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:43.227574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57c147-73e3-45a0-b6d3-30eb2bc483f7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:43.239546 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1352/2711] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:43 2022] PUT /identity/v3/projects/efcca8e56e094adb920e0e0b59a8a122/users/5d7ce6f6a0044d46bd78fa61aa0d1940/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:41:43.252527 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe5b83-0673-47d3-ad2d-b40a9bb7ee8e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:43.252980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe5b83-0673-47d3-ad2d-b40a9bb7ee8e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:43.253278 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe5b83-0673-47d3-ad2d-b40a9bb7ee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:43.284373 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-63fe5b83-0673-47d3-ad2d-b40a9bb7ee8e None None] MFA Rules not processed for user `5d7ce6f6a0044d46bd78fa61aa0d1940`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:43.285579 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-63fe5b83-0673-47d3-ad2d-b40a9bb7ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:43.290836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:43.377492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1360/2712] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:43.389964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57c147-73e3-45a0-b6d3-30eb2bc483f7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:43.391964 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6d57c147-73e3-45a0-b6d3-30eb2bc483f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:43.451753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57c147-73e3-45a0-b6d3-30eb2bc483f7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:43.455439 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c682-194f-4ae6-a621-a387c779d149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:43.456039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c682-194f-4ae6-a621-a387c779d149 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:43.456318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c682-194f-4ae6-a621-a387c779d149 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:43.456649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c682-194f-4ae6-a621-a387c779d149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:43.466730 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652c682-194f-4ae6-a621-a387c779d149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:43.468235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652c682-194f-4ae6-a621-a387c779d149 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:43.479014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1353/2713] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:43.592760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe5b83-0673-47d3-ad2d-b40a9bb7ee8e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:43.603480 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe5b83-0673-47d3-ad2d-b40a9bb7ee8e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:43.607829 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b1c90-2367-4ebe-a628-1d1c1a7a8414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:43.608870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b1c90-2367-4ebe-a628-1d1c1a7a8414 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:43.609156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b1c90-2367-4ebe-a628-1d1c1a7a8414 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:43.609430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b1c90-2367-4ebe-a628-1d1c1a7a8414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:43.676152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b1c90-2367-4ebe-a628-1d1c1a7a8414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:43.677517 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b1c90-2367-4ebe-a628-1d1c1a7a8414 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:43.693214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1361/2714] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:46.316435 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c682-194f-4ae6-a621-a387c779d149 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:46.357866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:46.382446 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c682-194f-4ae6-a621-a387c779d149 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:46.388536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:46.389303 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:46.389576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:46.389854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] PATH_INFO: `/v3/users/aa4b64d424184a77993e36ed2ced7ea1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:46.391380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4b64d424184a77993e36ed2ced7ea1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:46.393563 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:46.441796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4b64d424184a77993e36ed2ced7ea1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:46.449107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4b64d424184a77993e36ed2ced7ea1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:46.449752 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4b64d424184a77993e36ed2ced7ea1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:46.462102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4b64d424184a77993e36ed2ced7ea1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:46.469734 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4b64d424184a77993e36ed2ced7ea1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:46.475546 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1354/2715] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:46 2022] DELETE /identity/v3/users/aa4b64d424184a77993e36ed2ced7ea1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:46.480009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5d79e-2232-433b-80b4-60f7efa68899 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:46.480487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5d79e-2232-433b-80b4-60f7efa68899 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:46.480586 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5d79e-2232-433b-80b4-60f7efa68899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:46.500884 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-afb5d79e-2232-433b-80b4-60f7efa68899 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:46.502074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-afb5d79e-2232-433b-80b4-60f7efa68899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:46.559994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1362/2716] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:46.569788 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:46.571262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:46.628384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8096db-1e6a-407d-908e-815bada4bfdc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:46.632070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e08d-af77-43f6-82cd-8973a0da8e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:46.632664 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e08d-af77-43f6-82cd-8973a0da8e05 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:46.632943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e08d-af77-43f6-82cd-8973a0da8e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:46.633213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e08d-af77-43f6-82cd-8973a0da8e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:46.642371 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0e08d-af77-43f6-82cd-8973a0da8e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:46.643835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0e08d-af77-43f6-82cd-8973a0da8e05 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:46.653218 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1355/2717] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:41:46.930948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5d79e-2232-433b-80b4-60f7efa68899 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:46.932397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-afb5d79e-2232-433b-80b4-60f7efa68899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:46.944853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5d79e-2232-433b-80b4-60f7efa68899 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:46.950722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:46.951582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:46.951848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:46.952178 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] PATH_INFO: `/v3/projects/86335f3e87824b55a5bc7d26e74afd00` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:46.953273 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86335f3e87824b55a5bc7d26e74afd00)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:46.955282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:46.995349 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:47.008071 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86335f3e87824b55a5bc7d26e74afd00', 'request_id': 'req-1330ef3b-5823-41b2-8d60-d46eb75e30b0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.020846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86335f3e87824b55a5bc7d26e74afd00', 'request_id': 'req-1330ef3b-5823-41b2-8d60-d46eb75e30b0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.029372 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86335f3e87824b55a5bc7d26e74afd00', 'request_id': 'req-1330ef3b-5823-41b2-8d60-d46eb75e30b0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.041449 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] The token cache is being invalidate because project 86335f3e87824b55a5bc7d26e74afd00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:47.041773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.042434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.044749 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1363/2718] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:46 2022] DELETE /identity/v3/projects/86335f3e87824b55a5bc7d26e74afd00 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:47.051421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e08d-af77-43f6-82cd-8973a0da8e05 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:47.061161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e08d-af77-43f6-82cd-8973a0da8e05 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:47.115671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:47.116298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:47.116578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:47.116884 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] PATH_INFO: `/v3/users/5d7ce6f6a0044d46bd78fa61aa0d1940` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:47.118025 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7ce6f6a0044d46bd78fa61aa0d1940)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:47.120244 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:47.122674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:47.168804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7ce6f6a0044d46bd78fa61aa0d1940'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.175577 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7ce6f6a0044d46bd78fa61aa0d1940'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.176338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7ce6f6a0044d46bd78fa61aa0d1940'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.188523 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7ce6f6a0044d46bd78fa61aa0d1940'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.195208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fa922c07-1925-4a2a-8534-f4a449c616c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7ce6f6a0044d46bd78fa61aa0d1940'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.201587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1356/2719] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:47 2022] DELETE /identity/v3/users/5d7ce6f6a0044d46bd78fa61aa0d1940 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:47.479815 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:47.481589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:47.495569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330ef3b-5823-41b2-8d60-d46eb75e30b0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:47.551974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:47.552609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:47.552917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:47.553192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] PATH_INFO: `/v3/projects/efcca8e56e094adb920e0e0b59a8a122` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:47.554304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcca8e56e094adb920e0e0b59a8a122)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:47.556235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:47.602051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcca8e56e094adb920e0e0b59a8a122', 'request_id': 'req-407bcba7-568b-4593-ad1a-75e0784f0d0d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.608775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcca8e56e094adb920e0e0b59a8a122', 'request_id': 'req-407bcba7-568b-4593-ad1a-75e0784f0d0d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.614405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcca8e56e094adb920e0e0b59a8a122', 'request_id': 'req-407bcba7-568b-4593-ad1a-75e0784f0d0d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.626394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] The token cache is being invalidate because project efcca8e56e094adb920e0e0b59a8a122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:47.626697 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.627327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-407bcba7-568b-4593-ad1a-75e0784f0d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:47.628819 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1364/2720] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:47 2022] DELETE /identity/v3/projects/efcca8e56e094adb920e0e0b59a8a122 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:47.633668 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3e26a-d608-4063-a9d6-6323d6bc16cb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:47.634135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3e26a-d608-4063-a9d6-6323d6bc16cb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:47.634231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3e26a-d608-4063-a9d6-6323d6bc16cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:47.656400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-13a3e26a-d608-4063-a9d6-6323d6bc16cb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:47.657633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-13a3e26a-d608-4063-a9d6-6323d6bc16cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:47.719319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1357/2721] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:47.728175 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13b946-269e-4d9d-ada5-84d468f51b60 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:47.728460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13b946-269e-4d9d-ada5-84d468f51b60 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:47.728734 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13b946-269e-4d9d-ada5-84d468f51b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:47.748921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-df13b946-269e-4d9d-ada5-84d468f51b60 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:47.750111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df13b946-269e-4d9d-ada5-84d468f51b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:47.758035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1365/2722] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:47.762186 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3e26a-d608-4063-a9d6-6323d6bc16cb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:47.772399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3e26a-d608-4063-a9d6-6323d6bc16cb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:47.777036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dbb57-b37a-46c4-955f-4a78e4bb81c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:47.777628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dbb57-b37a-46c4-955f-4a78e4bb81c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:47.777903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dbb57-b37a-46c4-955f-4a78e4bb81c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:47.778260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dbb57-b37a-46c4-955f-4a78e4bb81c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:47.778943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dbb57-b37a-46c4-955f-4a78e4bb81c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:41:47.779241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dbb57-b37a-46c4-955f-4a78e4bb81c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:47.780916 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dbb57-b37a-46c4-955f-4a78e4bb81c2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:47.792164 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1358/2723] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:41:47.796467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13b946-269e-4d9d-ada5-84d468f51b60 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:47.806001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13b946-269e-4d9d-ada5-84d468f51b60 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:47.811360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82756c-7d53-4a95-87fa-00d0d8fe0cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:47.811955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82756c-7d53-4a95-87fa-00d0d8fe0cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:47.812233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82756c-7d53-4a95-87fa-00d0d8fe0cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:47.812503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82756c-7d53-4a95-87fa-00d0d8fe0cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:47.813139 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82756c-7d53-4a95-87fa-00d0d8fe0cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:47.815083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82756c-7d53-4a95-87fa-00d0d8fe0cd4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:47.842042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1366/2724] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:47 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:47.846262 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dbb57-b37a-46c4-955f-4a78e4bb81c2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:47.856166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dbb57-b37a-46c4-955f-4a78e4bb81c2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:47.912326 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebd383-9e84-406d-9630-b54fbec4bac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:47.912920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebd383-9e84-406d-9630-b54fbec4bac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:47.913200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebd383-9e84-406d-9630-b54fbec4bac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:47.913472 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebd383-9e84-406d-9630-b54fbec4bac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:47.914091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebd383-9e84-406d-9630-b54fbec4bac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:47.916013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebd383-9e84-406d-9630-b54fbec4bac3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:47.932264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:47.938818 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1359/2725] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:47 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:47.942548 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82756c-7d53-4a95-87fa-00d0d8fe0cd4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:47.953583 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82756c-7d53-4a95-87fa-00d0d8fe0cd4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:47.958293 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2f333-3758-489f-aaf6-35a366f48608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:47.958922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2f333-3758-489f-aaf6-35a366f48608 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:47.959201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2f333-3758-489f-aaf6-35a366f48608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:47.959474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2f333-3758-489f-aaf6-35a366f48608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:47.960116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2f333-3758-489f-aaf6-35a366f48608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:47.961721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2f333-3758-489f-aaf6-35a366f48608 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:47.972235 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1367/2726] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:47.975977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebd383-9e84-406d-9630-b54fbec4bac3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:47.985875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebd383-9e84-406d-9630-b54fbec4bac3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:47.990586 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845fb31-c020-4616-a62d-c80830cf0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:47.991214 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845fb31-c020-4616-a62d-c80830cf0d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:47.991490 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845fb31-c020-4616-a62d-c80830cf0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:47.991757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845fb31-c020-4616-a62d-c80830cf0d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:47.992391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845fb31-c020-4616-a62d-c80830cf0d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:47.994269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845fb31-c020-4616-a62d-c80830cf0d4b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.006221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1360/2727] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:48.010587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2f333-3758-489f-aaf6-35a366f48608 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.022246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2f333-3758-489f-aaf6-35a366f48608 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.027126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c483750-d358-4952-9b23-1edad99fc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.027816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c483750-d358-4952-9b23-1edad99fc80b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.028218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c483750-d358-4952-9b23-1edad99fc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.029023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c483750-d358-4952-9b23-1edad99fc80b admin admin] PATH_INFO: `/v3/projects/e274735cf25541ceb5a108d5f986f009/users/76fee1067d9244aca9a9d1d342832623/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.042342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:48.047163 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c483750-d358-4952-9b23-1edad99fc80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e274735cf25541ceb5a108d5f986f009, user_id=76fee1067d9244aca9a9d1d342832623, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.050382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c483750-d358-4952-9b23-1edad99fc80b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.063738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1368/2728] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:48 2022] PUT /identity/v3/projects/e274735cf25541ceb5a108d5f986f009/users/76fee1067d9244aca9a9d1d342832623/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:48.073950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8bdff-4b51-4d98-8096-5cf69212df59 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.074231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8bdff-4b51-4d98-8096-5cf69212df59 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.074502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8bdff-4b51-4d98-8096-5cf69212df59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.102917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cce8bdff-4b51-4d98-8096-5cf69212df59 None None] MFA Rules not processed for user `76fee1067d9244aca9a9d1d342832623`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:48.104105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cce8bdff-4b51-4d98-8096-5cf69212df59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:48.167182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1361/2729] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:48.172095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c483750-d358-4952-9b23-1edad99fc80b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.232698 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c483750-d358-4952-9b23-1edad99fc80b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.237299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4595c-a9a5-4326-a7c1-078e593a9d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.237922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4595c-a9a5-4326-a7c1-078e593a9d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.238195 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4595c-a9a5-4326-a7c1-078e593a9d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.238460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4595c-a9a5-4326-a7c1-078e593a9d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.240088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4595c-a9a5-4326-a7c1-078e593a9d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.241021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4595c-a9a5-4326-a7c1-078e593a9d44 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.267464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1369/2730] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:48 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:48.271586 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8bdff-4b51-4d98-8096-5cf69212df59 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.282587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8bdff-4b51-4d98-8096-5cf69212df59 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.336843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29397e18-d81e-4778-a181-4ac2eb5cea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.337441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29397e18-d81e-4778-a181-4ac2eb5cea75 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.337745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29397e18-d81e-4778-a181-4ac2eb5cea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.338045 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29397e18-d81e-4778-a181-4ac2eb5cea75 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.338731 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29397e18-d81e-4778-a181-4ac2eb5cea75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.340753 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29397e18-d81e-4778-a181-4ac2eb5cea75 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.364020 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1362/2731] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:48 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:48.368267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4595c-a9a5-4326-a7c1-078e593a9d44 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.379824 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4595c-a9a5-4326-a7c1-078e593a9d44 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.384530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced3e88-0e81-4cba-9099-2de55a3f4fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.385144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced3e88-0e81-4cba-9099-2de55a3f4fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.385422 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced3e88-0e81-4cba-9099-2de55a3f4fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.385694 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced3e88-0e81-4cba-9099-2de55a3f4fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.386339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced3e88-0e81-4cba-9099-2de55a3f4fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.388663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced3e88-0e81-4cba-9099-2de55a3f4fdc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.399553 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1370/2732] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:48.403898 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29397e18-d81e-4778-a181-4ac2eb5cea75 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.413971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29397e18-d81e-4778-a181-4ac2eb5cea75 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.418633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73449ed-e21c-426e-87a0-887cde59bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.419295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73449ed-e21c-426e-87a0-887cde59bf7a admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.419515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73449ed-e21c-426e-87a0-887cde59bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.419786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73449ed-e21c-426e-87a0-887cde59bf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.420424 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73449ed-e21c-426e-87a0-887cde59bf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.422014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73449ed-e21c-426e-87a0-887cde59bf7a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.431809 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1363/2733] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:48.436334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced3e88-0e81-4cba-9099-2de55a3f4fdc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.446048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced3e88-0e81-4cba-9099-2de55a3f4fdc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.451327 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc82b4f-c839-49bc-be66-13709cae4abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.451961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc82b4f-c839-49bc-be66-13709cae4abf admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.452241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc82b4f-c839-49bc-be66-13709cae4abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.452514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc82b4f-c839-49bc-be66-13709cae4abf admin admin] PATH_INFO: `/v3/projects/5a0d205d8cc5447c9fce4e71e34b9d66/users/fd268e9b497b4edc8da0895ccc283038/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.466628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc82b4f-c839-49bc-be66-13709cae4abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0d205d8cc5447c9fce4e71e34b9d66, user_id=fd268e9b497b4edc8da0895ccc283038, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.469288 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc82b4f-c839-49bc-be66-13709cae4abf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.482064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1371/2734] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:48 2022] PUT /identity/v3/projects/5a0d205d8cc5447c9fce4e71e34b9d66/users/fd268e9b497b4edc8da0895ccc283038/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:41:48.492864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7c30-13b4-483e-8ea6-ca8ee43bddef None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.493155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7c30-13b4-483e-8ea6-ca8ee43bddef None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.493697 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7c30-13b4-483e-8ea6-ca8ee43bddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.522264 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e5ca7c30-13b4-483e-8ea6-ca8ee43bddef None None] MFA Rules not processed for user `fd268e9b497b4edc8da0895ccc283038`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:48.523525 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e5ca7c30-13b4-483e-8ea6-ca8ee43bddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:48.566441 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:48.588827 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1364/2735] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:48.593270 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc82b4f-c839-49bc-be66-13709cae4abf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.653525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc82b4f-c839-49bc-be66-13709cae4abf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.658151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87736b-3eab-465f-a7c3-1c4efb3b5b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.658777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87736b-3eab-465f-a7c3-1c4efb3b5b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.659053 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87736b-3eab-465f-a7c3-1c4efb3b5b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.659318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87736b-3eab-465f-a7c3-1c4efb3b5b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.659933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87736b-3eab-465f-a7c3-1c4efb3b5b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.661838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87736b-3eab-465f-a7c3-1c4efb3b5b61 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.688644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1372/2736] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:48 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:48.692718 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca7c30-13b4-483e-8ea6-ca8ee43bddef None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.704400 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca7c30-13b4-483e-8ea6-ca8ee43bddef None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.764968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e30562-9b9a-4985-9a1d-48f87db1f0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.765572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e30562-9b9a-4985-9a1d-48f87db1f0de admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.765853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e30562-9b9a-4985-9a1d-48f87db1f0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.766125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e30562-9b9a-4985-9a1d-48f87db1f0de admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.766808 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e30562-9b9a-4985-9a1d-48f87db1f0de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.768746 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e30562-9b9a-4985-9a1d-48f87db1f0de admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.791721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1365/2737] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:48 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:48.792903 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87736b-3eab-465f-a7c3-1c4efb3b5b61 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.803834 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87736b-3eab-465f-a7c3-1c4efb3b5b61 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.808474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428bc5-d7ed-4080-ad65-d93c611fe31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.809080 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428bc5-d7ed-4080-ad65-d93c611fe31c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.809462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428bc5-d7ed-4080-ad65-d93c611fe31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.810290 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428bc5-d7ed-4080-ad65-d93c611fe31c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.810966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428bc5-d7ed-4080-ad65-d93c611fe31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.812603 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428bc5-d7ed-4080-ad65-d93c611fe31c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.823039 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1373/2738] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:41:48.827267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e30562-9b9a-4985-9a1d-48f87db1f0de admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.837127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e30562-9b9a-4985-9a1d-48f87db1f0de admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.841897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557f03b-2240-4f90-a6e3-115ae8858419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.842532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557f03b-2240-4f90-a6e3-115ae8858419 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.842918 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557f03b-2240-4f90-a6e3-115ae8858419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.843193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557f03b-2240-4f90-a6e3-115ae8858419 admin admin] PATH_INFO: `/v3/projects/c75e3503a14545c9ab9db9c9246a4eb3/users/810e9f6869e3427298523ac0c01dd383/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.858117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557f03b-2240-4f90-a6e3-115ae8858419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75e3503a14545c9ab9db9c9246a4eb3, user_id=810e9f6869e3427298523ac0c01dd383, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.860804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557f03b-2240-4f90-a6e3-115ae8858419 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.874117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1366/2739] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:48 2022] PUT /identity/v3/projects/c75e3503a14545c9ab9db9c9246a4eb3/users/810e9f6869e3427298523ac0c01dd383/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:48.878128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428bc5-d7ed-4080-ad65-d93c611fe31c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.888639 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428bc5-d7ed-4080-ad65-d93c611fe31c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.897588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:48.946797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778da072-bd7d-4067-9798-5d2c41c8f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.947311 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778da072-bd7d-4067-9798-5d2c41c8f1cb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.947589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778da072-bd7d-4067-9798-5d2c41c8f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.947858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778da072-bd7d-4067-9798-5d2c41c8f1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.948484 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778da072-bd7d-4067-9798-5d2c41c8f1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.950185 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778da072-bd7d-4067-9798-5d2c41c8f1cb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.959724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1374/2740] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:48.964023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557f03b-2240-4f90-a6e3-115ae8858419 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:48.974157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557f03b-2240-4f90-a6e3-115ae8858419 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:48.979065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216497b-7469-4f64-8a67-913c1089e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:48.979721 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216497b-7469-4f64-8a67-913c1089e183 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:48.980113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216497b-7469-4f64-8a67-913c1089e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:48.980389 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216497b-7469-4f64-8a67-913c1089e183 admin admin] PATH_INFO: `/v3/projects/c75e3503a14545c9ab9db9c9246a4eb3/users/810e9f6869e3427298523ac0c01dd383/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:48.982927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216497b-7469-4f64-8a67-913c1089e183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75e3503a14545c9ab9db9c9246a4eb3, user_id=810e9f6869e3427298523ac0c01dd383, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:48.985573 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216497b-7469-4f64-8a67-913c1089e183 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:48.996018 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1367/2741] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:48 2022] PUT /identity/v3/projects/c75e3503a14545c9ab9db9c9246a4eb3/users/810e9f6869e3427298523ac0c01dd383/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:41:49.006727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05a388-bd84-4b06-b9e5-d0a3cccac28c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:49.007040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05a388-bd84-4b06-b9e5-d0a3cccac28c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:49.007313 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05a388-bd84-4b06-b9e5-d0a3cccac28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:49.039722 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2d05a388-bd84-4b06-b9e5-d0a3cccac28c None None] MFA Rules not processed for user `810e9f6869e3427298523ac0c01dd383`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:49.040984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2d05a388-bd84-4b06-b9e5-d0a3cccac28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:49.112994 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1375/2742] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:49.125293 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216497b-7469-4f64-8a67-913c1089e183 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:49.127094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b216497b-7469-4f64-8a67-913c1089e183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:49.187726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216497b-7469-4f64-8a67-913c1089e183 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:49.191388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afe26-e1da-4016-9a69-b3c77bd63158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:49.191983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afe26-e1da-4016-9a69-b3c77bd63158 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:49.192260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afe26-e1da-4016-9a69-b3c77bd63158 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:49.192529 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afe26-e1da-4016-9a69-b3c77bd63158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:49.202040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228afe26-e1da-4016-9a69-b3c77bd63158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:49.203421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228afe26-e1da-4016-9a69-b3c77bd63158 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:49.212671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1368/2743] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:49.253298 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05a388-bd84-4b06-b9e5-d0a3cccac28c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:49.254718 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2d05a388-bd84-4b06-b9e5-d0a3cccac28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:49.267667 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05a388-bd84-4b06-b9e5-d0a3cccac28c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:49.271243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37d3b-35e6-47c0-b22b-47a665993e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:49.271837 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37d3b-35e6-47c0-b22b-47a665993e55 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:49.272119 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37d3b-35e6-47c0-b22b-47a665993e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:49.272385 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37d3b-35e6-47c0-b22b-47a665993e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:49.330628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f37d3b-35e6-47c0-b22b-47a665993e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:49.332164 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f37d3b-35e6-47c0-b22b-47a665993e55 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:49.344338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1376/2744] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:52.229653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afe26-e1da-4016-9a69-b3c77bd63158 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:52.271465 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:52.293180 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afe26-e1da-4016-9a69-b3c77bd63158 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:52.298460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:52.299195 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:52.299409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:52.299680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] PATH_INFO: `/v3/users/76fee1067d9244aca9a9d1d342832623` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:52.300815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fee1067d9244aca9a9d1d342832623)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:52.302757 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:52.349763 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fee1067d9244aca9a9d1d342832623'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.357248 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fee1067d9244aca9a9d1d342832623'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.357875 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fee1067d9244aca9a9d1d342832623'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.370065 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fee1067d9244aca9a9d1d342832623'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.377561 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fee1067d9244aca9a9d1d342832623'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.383834 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1369/2745] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:52 2022] DELETE /identity/v3/users/76fee1067d9244aca9a9d1d342832623 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:52.389013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e9fc-9058-41b9-a2d3-213f504f89f5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:52.389486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e9fc-9058-41b9-a2d3-213f504f89f5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:52.389594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e9fc-9058-41b9-a2d3-213f504f89f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:52.408083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b254e9fc-9058-41b9-a2d3-213f504f89f5 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:52.409191 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b254e9fc-9058-41b9-a2d3-213f504f89f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:52.438064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:52.467787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1377/2746] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:52.477680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:52.479131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:52.536392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aec2e-a948-4021-8ebb-ccaa1de3b6fd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:52.539979 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2042739-60a6-46ee-9de9-d1452f19f802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:52.540569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042739-60a6-46ee-9de9-d1452f19f802 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:52.540842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042739-60a6-46ee-9de9-d1452f19f802 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:52.541110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042739-60a6-46ee-9de9-d1452f19f802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:52.550540 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2042739-60a6-46ee-9de9-d1452f19f802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:52.551997 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2042739-60a6-46ee-9de9-d1452f19f802 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:52.561892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1370/2747] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:41:52.835063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e9fc-9058-41b9-a2d3-213f504f89f5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:52.836464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b254e9fc-9058-41b9-a2d3-213f504f89f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:52.849321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e9fc-9058-41b9-a2d3-213f504f89f5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:52.854189 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:52.854863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:52.855143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:52.855416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] PATH_INFO: `/v3/projects/e274735cf25541ceb5a108d5f986f009` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:52.857426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e274735cf25541ceb5a108d5f986f009)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:52.859147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:52.925459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e274735cf25541ceb5a108d5f986f009', 'request_id': 'req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.934606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e274735cf25541ceb5a108d5f986f009', 'request_id': 'req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.940395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e274735cf25541ceb5a108d5f986f009', 'request_id': 'req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.952312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] The token cache is being invalidate because project e274735cf25541ceb5a108d5f986f009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:52.952606 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.953274 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:52.955111 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1378/2748] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:52 2022] DELETE /identity/v3/projects/e274735cf25541ceb5a108d5f986f009 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:52.959017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2042739-60a6-46ee-9de9-d1452f19f802 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:52.970924 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2042739-60a6-46ee-9de9-d1452f19f802 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:53.028858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:53.029531 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:53.029840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:53.030112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] PATH_INFO: `/v3/users/fd268e9b497b4edc8da0895ccc283038` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:53.031367 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd268e9b497b4edc8da0895ccc283038)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:53.033235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:53.035819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:53.083029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd268e9b497b4edc8da0895ccc283038'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.092491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd268e9b497b4edc8da0895ccc283038'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.093271 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd268e9b497b4edc8da0895ccc283038'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.105460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd268e9b497b4edc8da0895ccc283038'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.113114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd268e9b497b4edc8da0895ccc283038'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.121051 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1371/2749] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:52 2022] DELETE /identity/v3/users/fd268e9b497b4edc8da0895ccc283038 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:53.399564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:53.401072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:53.415564 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0dc0e-e1cc-4f9b-80f2-567238b2d38e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:53.474428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:53.475093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:53.475375 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:53.475650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] PATH_INFO: `/v3/projects/5a0d205d8cc5447c9fce4e71e34b9d66` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:53.476775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0d205d8cc5447c9fce4e71e34b9d66)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:53.478820 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:53.524727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0d205d8cc5447c9fce4e71e34b9d66', 'request_id': 'req-f36e2475-8b1e-41d2-95b4-02748eaa57f0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.536411 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0d205d8cc5447c9fce4e71e34b9d66', 'request_id': 'req-f36e2475-8b1e-41d2-95b4-02748eaa57f0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.538339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:53.542628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0d205d8cc5447c9fce4e71e34b9d66', 'request_id': 'req-f36e2475-8b1e-41d2-95b4-02748eaa57f0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.554430 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] The token cache is being invalidate because project 5a0d205d8cc5447c9fce4e71e34b9d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:53.554741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.555377 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.556847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1379/2750] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:53 2022] DELETE /identity/v3/projects/5a0d205d8cc5447c9fce4e71e34b9d66 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:41:53.561927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:53.563433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:53.576640 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f7932-9749-41c7-a13a-944b54183350 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:53.632659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:53.633283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:53.633565 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:53.633836 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] PATH_INFO: `/v3/users/810e9f6869e3427298523ac0c01dd383` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:53.635002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=810e9f6869e3427298523ac0c01dd383)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:53.637066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:53.682501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810e9f6869e3427298523ac0c01dd383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.690311 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810e9f6869e3427298523ac0c01dd383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.690961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810e9f6869e3427298523ac0c01dd383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.703726 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810e9f6869e3427298523ac0c01dd383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.710429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2ef7cb93-2502-4b28-ba83-a951e45b44c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810e9f6869e3427298523ac0c01dd383'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:53.712694 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:53.717486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1372/2751] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:53 2022] DELETE /identity/v3/users/810e9f6869e3427298523ac0c01dd383 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:54.287724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:54.289135 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:54.304388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e2475-8b1e-41d2-95b4-02748eaa57f0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:54.370031 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:54.370656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.370961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.371230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] PATH_INFO: `/v3/projects/c75e3503a14545c9ab9db9c9246a4eb3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:54.372361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75e3503a14545c9ab9db9c9246a4eb3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:54.374505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:54.427996 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75e3503a14545c9ab9db9c9246a4eb3', 'request_id': 'req-995ea93b-3d72-49b0-a357-db3bebc6fab1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:54.436007 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75e3503a14545c9ab9db9c9246a4eb3', 'request_id': 'req-995ea93b-3d72-49b0-a357-db3bebc6fab1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:54.442068 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75e3503a14545c9ab9db9c9246a4eb3', 'request_id': 'req-995ea93b-3d72-49b0-a357-db3bebc6fab1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:54.456211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] The token cache is being invalidate because project c75e3503a14545c9ab9db9c9246a4eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:41:54.456503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:54.457171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-995ea93b-3d72-49b0-a357-db3bebc6fab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:54.463204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1380/2752] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:41:54 2022] DELETE /identity/v3/projects/c75e3503a14545c9ab9db9c9246a4eb3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:54.464764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e3b81-dadf-4405-a7f1-31f88056b6b1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.465118 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e3b81-dadf-4405-a7f1-31f88056b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.466006 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e3b81-dadf-4405-a7f1-31f88056b6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:54.486675 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-415e3b81-dadf-4405-a7f1-31f88056b6b1 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:54.487983 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-415e3b81-dadf-4405-a7f1-31f88056b6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:54.553869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1373/2753] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:54.562528 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e853c14-209c-4818-b978-e978b9c64ccd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.562848 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e853c14-209c-4818-b978-e978b9c64ccd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.563129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e853c14-209c-4818-b978-e978b9c64ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:54.585569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1e853c14-209c-4818-b978-e978b9c64ccd None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:54.586826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1e853c14-209c-4818-b978-e978b9c64ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:54.595049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1381/2754] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:54.599250 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e3b81-dadf-4405-a7f1-31f88056b6b1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:54.609255 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e3b81-dadf-4405-a7f1-31f88056b6b1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:54.613865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39c90-9f9b-4c22-9625-71805b78f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:54.614458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39c90-9f9b-4c22-9625-71805b78f8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.614768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39c90-9f9b-4c22-9625-71805b78f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.615040 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39c90-9f9b-4c22-9625-71805b78f8c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:54.615680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d39c90-9f9b-4c22-9625-71805b78f8c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:41:54.615978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d39c90-9f9b-4c22-9625-71805b78f8c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:54.617603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d39c90-9f9b-4c22-9625-71805b78f8c2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:54.633847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1374/2755] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:41:54.636072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e853c14-209c-4818-b978-e978b9c64ccd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:54.646034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e853c14-209c-4818-b978-e978b9c64ccd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:54.650628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740ca57-2508-407c-9b0c-38f79c0d35ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:54.651251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740ca57-2508-407c-9b0c-38f79c0d35ba admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.651523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740ca57-2508-407c-9b0c-38f79c0d35ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.651858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740ca57-2508-407c-9b0c-38f79c0d35ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:54.652488 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740ca57-2508-407c-9b0c-38f79c0d35ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:54.654487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740ca57-2508-407c-9b0c-38f79c0d35ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:54.683116 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1382/2756] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:54 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:54.688094 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39c90-9f9b-4c22-9625-71805b78f8c2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:54.699874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39c90-9f9b-4c22-9625-71805b78f8c2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:54.765507 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce16d96-6d98-4e04-8a09-87316c352d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:54.766237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce16d96-6d98-4e04-8a09-87316c352d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.766649 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce16d96-6d98-4e04-8a09-87316c352d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.767767 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce16d96-6d98-4e04-8a09-87316c352d05 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:54.768536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce16d96-6d98-4e04-8a09-87316c352d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:54.771306 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce16d96-6d98-4e04-8a09-87316c352d05 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:54.799502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1375/2757] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:54 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:41:54.803933 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740ca57-2508-407c-9b0c-38f79c0d35ba admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:54.816156 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740ca57-2508-407c-9b0c-38f79c0d35ba admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:54.821633 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8210f-6f95-4608-bd21-dc0ef3534a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:54.822405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8210f-6f95-4608-bd21-dc0ef3534a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.822816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8210f-6f95-4608-bd21-dc0ef3534a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.823182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8210f-6f95-4608-bd21-dc0ef3534a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:54.824081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8210f-6f95-4608-bd21-dc0ef3534a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:54.826266 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8210f-6f95-4608-bd21-dc0ef3534a2c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:54.838985 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1383/2758] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:54.843558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce16d96-6d98-4e04-8a09-87316c352d05 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:54.854128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce16d96-6d98-4e04-8a09-87316c352d05 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:54.860245 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302944-0c4d-4f08-bb4a-b429450c1f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:54.861066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302944-0c4d-4f08-bb4a-b429450c1f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.861575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302944-0c4d-4f08-bb4a-b429450c1f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.862000 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302944-0c4d-4f08-bb4a-b429450c1f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:54.862858 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302944-0c4d-4f08-bb4a-b429450c1f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:54.864952 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302944-0c4d-4f08-bb4a-b429450c1f8b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:54.883593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1376/2759] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:54.885688 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8210f-6f95-4608-bd21-dc0ef3534a2c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:54.896660 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8210f-6f95-4608-bd21-dc0ef3534a2c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:54.902618 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1db24-a556-4051-aaef-17dff1bb9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:54.903600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1db24-a556-4051-aaef-17dff1bb9414 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.903984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1db24-a556-4051-aaef-17dff1bb9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.904355 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1db24-a556-4051-aaef-17dff1bb9414 admin admin] PATH_INFO: `/v3/projects/5eb1cf2081514a61bdaef5b5dbde0998/users/ea517f608fad465fa4cfe093bf76be5c/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:54.927136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1db24-a556-4051-aaef-17dff1bb9414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb1cf2081514a61bdaef5b5dbde0998, user_id=ea517f608fad465fa4cfe093bf76be5c, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:54.929992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1db24-a556-4051-aaef-17dff1bb9414 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:54.949978 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1384/2760] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:54 2022] PUT /identity/v3/projects/5eb1cf2081514a61bdaef5b5dbde0998/users/ea517f608fad465fa4cfe093bf76be5c/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:54.970948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb554d8-b0b4-4d3c-95eb-ad7f6104b0fc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:54.971290 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb554d8-b0b4-4d3c-95eb-ad7f6104b0fc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:54.971596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb554d8-b0b4-4d3c-95eb-ad7f6104b0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:55.002881 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5cb554d8-b0b4-4d3c-95eb-ad7f6104b0fc None None] MFA Rules not processed for user `ea517f608fad465fa4cfe093bf76be5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:55.004148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5cb554d8-b0b4-4d3c-95eb-ad7f6104b0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:55.065334 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:55.081644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1377/2761] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:55.083468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1db24-a556-4051-aaef-17dff1bb9414 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:55.098383 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:55.153588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1db24-a556-4051-aaef-17dff1bb9414 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:55.158498 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e3ea7-d4ab-4e6c-bbce-bcb1789c8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:55.159147 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e3ea7-d4ab-4e6c-bbce-bcb1789c8bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:55.159424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e3ea7-d4ab-4e6c-bbce-bcb1789c8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:55.159708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e3ea7-d4ab-4e6c-bbce-bcb1789c8bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:55.160324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e3ea7-d4ab-4e6c-bbce-bcb1789c8bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:55.162252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e3ea7-d4ab-4e6c-bbce-bcb1789c8bf4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:55.191596 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1385/2762] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:41:55 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:55.195639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb554d8-b0b4-4d3c-95eb-ad7f6104b0fc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:55.210167 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb554d8-b0b4-4d3c-95eb-ad7f6104b0fc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:55.273363 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01476-a7b0-4fd3-aed3-5de343041ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:55.274066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01476-a7b0-4fd3-aed3-5de343041ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:55.274354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01476-a7b0-4fd3-aed3-5de343041ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:55.274737 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01476-a7b0-4fd3-aed3-5de343041ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:55.275387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe01476-a7b0-4fd3-aed3-5de343041ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:55.277310 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe01476-a7b0-4fd3-aed3-5de343041ec4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:55.299469 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1378/2763] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:41:55 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:41:55.303477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e3ea7-d4ab-4e6c-bbce-bcb1789c8bf4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:55.317022 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e3ea7-d4ab-4e6c-bbce-bcb1789c8bf4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:55.322575 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d805-a420-431e-b42e-00f7b7248d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:55.326714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d805-a420-431e-b42e-00f7b7248d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:55.327520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d805-a420-431e-b42e-00f7b7248d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:55.330657 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d805-a420-431e-b42e-00f7b7248d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:55.331983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266d805-a420-431e-b42e-00f7b7248d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:55.334435 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266d805-a420-431e-b42e-00f7b7248d63 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:55.349170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1386/2764] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:55.353260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01476-a7b0-4fd3-aed3-5de343041ec4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:55.363544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01476-a7b0-4fd3-aed3-5de343041ec4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:55.368173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67d8c2-248b-46f3-88e5-8918b1072f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:55.369089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67d8c2-248b-46f3-88e5-8918b1072f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:55.369362 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67d8c2-248b-46f3-88e5-8918b1072f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:55.369629 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67d8c2-248b-46f3-88e5-8918b1072f93 admin admin] PATH_INFO: `/v3/projects/559882322d6941648450f3f346d58063/users/b21f4be72a99416799f8ae6b57891317/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:55.386226 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67d8c2-248b-46f3-88e5-8918b1072f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559882322d6941648450f3f346d58063, user_id=b21f4be72a99416799f8ae6b57891317, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:55.389495 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67d8c2-248b-46f3-88e5-8918b1072f93 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:55.408183 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1379/2765] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:55 2022] PUT /identity/v3/projects/559882322d6941648450f3f346d58063/users/b21f4be72a99416799f8ae6b57891317/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:55.412439 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d805-a420-431e-b42e-00f7b7248d63 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:55.424011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d805-a420-431e-b42e-00f7b7248d63 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:55.491196 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bc783-15f3-4869-be47-09da957ffc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:55.491878 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bc783-15f3-4869-be47-09da957ffc97 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:55.492088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bc783-15f3-4869-be47-09da957ffc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:55.492360 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bc783-15f3-4869-be47-09da957ffc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:55.493013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bc783-15f3-4869-be47-09da957ffc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:55.494965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bc783-15f3-4869-be47-09da957ffc97 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:55.506567 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1387/2766] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:41:55.510903 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67d8c2-248b-46f3-88e5-8918b1072f93 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:55.522166 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67d8c2-248b-46f3-88e5-8918b1072f93 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:55.527115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0128-1303-481e-aaea-cfd6931a6c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:55.527878 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0128-1303-481e-aaea-cfd6931a6c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:55.528477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0128-1303-481e-aaea-cfd6931a6c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:55.529240 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0128-1303-481e-aaea-cfd6931a6c85 admin admin] PATH_INFO: `/v3/projects/559882322d6941648450f3f346d58063/users/b21f4be72a99416799f8ae6b57891317/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:55.531383 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0128-1303-481e-aaea-cfd6931a6c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559882322d6941648450f3f346d58063, user_id=b21f4be72a99416799f8ae6b57891317, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:55.534103 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0128-1303-481e-aaea-cfd6931a6c85 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:55.546605 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1380/2767] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:41:55 2022] PUT /identity/v3/projects/559882322d6941648450f3f346d58063/users/b21f4be72a99416799f8ae6b57891317/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:55.557012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff4527-ee06-4b58-b23f-6f967a87eb7c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:55.557302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff4527-ee06-4b58-b23f-6f967a87eb7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:55.557579 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff4527-ee06-4b58-b23f-6f967a87eb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:55.588149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-00ff4527-ee06-4b58-b23f-6f967a87eb7c None None] MFA Rules not processed for user `b21f4be72a99416799f8ae6b57891317`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:55.589329 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00ff4527-ee06-4b58-b23f-6f967a87eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:55.673432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1388/2768] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:41:55.686570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0128-1303-481e-aaea-cfd6931a6c85 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:55.688724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-eb6b0128-1303-481e-aaea-cfd6931a6c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:55.776117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0128-1303-481e-aaea-cfd6931a6c85 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:55.781486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e94a3-ebcc-4865-8b9a-f4b11f92822c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:55.782231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e94a3-ebcc-4865-8b9a-f4b11f92822c service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:55.782572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e94a3-ebcc-4865-8b9a-f4b11f92822c service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:55.782967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e94a3-ebcc-4865-8b9a-f4b11f92822c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:55.850268 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e94a3-ebcc-4865-8b9a-f4b11f92822c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:55.851791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e94a3-ebcc-4865-8b9a-f4b11f92822c service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:55.865116 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1381/2769] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:41:59.539594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff4527-ee06-4b58-b23f-6f967a87eb7c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:59.540993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00ff4527-ee06-4b58-b23f-6f967a87eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:59.551604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:59.610617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff4527-ee06-4b58-b23f-6f967a87eb7c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:59.615130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:59.615754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:59.616029 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:59.616299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] PATH_INFO: `/v3/users/f3449c119e19463481340eaa7cf9f609` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:59.617397 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3449c119e19463481340eaa7cf9f609)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:59.619598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:59.668804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3449c119e19463481340eaa7cf9f609'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:59.681421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3449c119e19463481340eaa7cf9f609'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:59.689304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3449c119e19463481340eaa7cf9f609'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:59.697043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3449c119e19463481340eaa7cf9f609'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:59.697786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3449c119e19463481340eaa7cf9f609'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:41:59.704976 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1389/2770] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:41:59 2022] DELETE /identity/v3/users/f3449c119e19463481340eaa7cf9f609 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:41:59.709506 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bab7-baa6-428c-b828-b65996eb9618 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:59.709993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bab7-baa6-428c-b828-b65996eb9618 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:59.710105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bab7-baa6-428c-b828-b65996eb9618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:59.717074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:59.730292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4e51bab7-baa6-428c-b828-b65996eb9618 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:41:59.731603 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4e51bab7-baa6-428c-b828-b65996eb9618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:59.789409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1382/2771] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:41:59.799308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:41:59.800772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:41:59.857785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15725a0-12c4-4d5d-bbe2-c61e39a8c9f3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:41:59.861443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0b148-8a7e-4fb3-83de-2467c2bbbe8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:41:59.862042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0b148-8a7e-4fb3-83de-2467c2bbbe8d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:41:59.862321 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0b148-8a7e-4fb3-83de-2467c2bbbe8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:41:59.862594 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0b148-8a7e-4fb3-83de-2467c2bbbe8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:41:59.872342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0b148-8a7e-4fb3-83de-2467c2bbbe8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:41:59.873736 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0b148-8a7e-4fb3-83de-2467c2bbbe8d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:41:59.883033 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1390/2772] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:42:00.149560 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bab7-baa6-428c-b828-b65996eb9618 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:00.151041 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4e51bab7-baa6-428c-b828-b65996eb9618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:00.163570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bab7-baa6-428c-b828-b65996eb9618 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:00.170539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:00.178623 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:00.178992 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:00.179277 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] PATH_INFO: `/v3/projects/bb76d7faa61943c1ae79cba44ad631e1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:00.180538 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb76d7faa61943c1ae79cba44ad631e1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:00.182467 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:00.234161 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb76d7faa61943c1ae79cba44ad631e1', 'request_id': 'req-7e37e236-6bda-4c03-af76-d7843374d920'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:00.240790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb76d7faa61943c1ae79cba44ad631e1', 'request_id': 'req-7e37e236-6bda-4c03-af76-d7843374d920'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:00.248267 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb76d7faa61943c1ae79cba44ad631e1', 'request_id': 'req-7e37e236-6bda-4c03-af76-d7843374d920'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:00.264745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] The token cache is being invalidate because project bb76d7faa61943c1ae79cba44ad631e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:42:00.265039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:00.265759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7e37e236-6bda-4c03-af76-d7843374d920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:00.267513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1383/2773] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:42:00 2022] DELETE /identity/v3/projects/bb76d7faa61943c1ae79cba44ad631e1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:42:00.284357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0b148-8a7e-4fb3-83de-2467c2bbbe8d service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:00.286057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-72c0b148-8a7e-4fb3-83de-2467c2bbbe8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:00.327934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:00.358081 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0b148-8a7e-4fb3-83de-2467c2bbbe8d service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:00.415333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:00.416057 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:00.416414 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:00.416783 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:00.418843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:00.489551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:00.491048 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:00.502460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1391/2774] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:42:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:42:04.471656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e7a2-9b27-44d6-8063-dd7ae93865e8 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:04.472210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e7a2-9b27-44d6-8063-dd7ae93865e8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:04.472210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e7a2-9b27-44d6-8063-dd7ae93865e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:04.491815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e8b7e7a2-9b27-44d6-8063-dd7ae93865e8 None None] MFA Rules not processed for user `aee105e9d1ee44f985fdbac834330afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:42:04.493004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e8b7e7a2-9b27-44d6-8063-dd7ae93865e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:04.551777 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1384/2775] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:42:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:42:05.421078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:05.422550 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:05.495737 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b600a-c7ee-4096-92ed-3490e069006a service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:05.501655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:05.502299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:05.502659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:05.502981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] PATH_INFO: `/v3/users/ea517f608fad465fa4cfe093bf76be5c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:05.504128 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea517f608fad465fa4cfe093bf76be5c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:05.506091 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:05.549627 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:05.556789 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea517f608fad465fa4cfe093bf76be5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:05.570405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea517f608fad465fa4cfe093bf76be5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:05.578653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea517f608fad465fa4cfe093bf76be5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:05.586406 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea517f608fad465fa4cfe093bf76be5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:05.587326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea517f608fad465fa4cfe093bf76be5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:05.593772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1392/2776] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:42:05 2022] DELETE /identity/v3/users/ea517f608fad465fa4cfe093bf76be5c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:42:05.598238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840fdc-272c-4515-9342-90a7bc98c1aa None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:05.598751 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840fdc-272c-4515-9342-90a7bc98c1aa None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:05.599258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840fdc-272c-4515-9342-90a7bc98c1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:05.620618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b6840fdc-272c-4515-9342-90a7bc98c1aa None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:42:05.622073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b6840fdc-272c-4515-9342-90a7bc98c1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:05.648857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:05.686016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1385/2777] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:42:05.695934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:05.697492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:05.756905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fba87-666d-441b-a1c0-5972e18978b2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:05.760604 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a752c-aaa6-455a-8e53-24dc4e3a327e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:05.761229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a752c-aaa6-455a-8e53-24dc4e3a327e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:05.761571 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a752c-aaa6-455a-8e53-24dc4e3a327e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:05.761762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a752c-aaa6-455a-8e53-24dc4e3a327e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:05.772192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a752c-aaa6-455a-8e53-24dc4e3a327e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:05.773663 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a752c-aaa6-455a-8e53-24dc4e3a327e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:05.784513 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1393/2778] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:42:06.054639 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840fdc-272c-4515-9342-90a7bc98c1aa None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:06.056402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b6840fdc-272c-4515-9342-90a7bc98c1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:06.070449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840fdc-272c-4515-9342-90a7bc98c1aa None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:06.075119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:06.075905 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:06.076299 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:06.076579 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] PATH_INFO: `/v3/projects/5eb1cf2081514a61bdaef5b5dbde0998` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:06.077806 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb1cf2081514a61bdaef5b5dbde0998)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:06.079722 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:06.131785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb1cf2081514a61bdaef5b5dbde0998', 'request_id': 'req-c1f8611f-da15-4459-a12f-5b974684a416'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.138317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb1cf2081514a61bdaef5b5dbde0998', 'request_id': 'req-c1f8611f-da15-4459-a12f-5b974684a416'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.144304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb1cf2081514a61bdaef5b5dbde0998', 'request_id': 'req-c1f8611f-da15-4459-a12f-5b974684a416'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.160238 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] The token cache is being invalidate because project 5eb1cf2081514a61bdaef5b5dbde0998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:42:06.160671 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.161436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.162972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1386/2779] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:42:06 2022] DELETE /identity/v3/projects/5eb1cf2081514a61bdaef5b5dbde0998 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:42:06.167001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a752c-aaa6-455a-8e53-24dc4e3a327e service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:06.177532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a752c-aaa6-455a-8e53-24dc4e3a327e service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:06.251785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:06.252590 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:06.253078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:06.253425 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] PATH_INFO: `/v3/users/b21f4be72a99416799f8ae6b57891317` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:06.254662 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21f4be72a99416799f8ae6b57891317)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:06.257399 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:06.321253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21f4be72a99416799f8ae6b57891317'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.340474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:06.344585 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21f4be72a99416799f8ae6b57891317'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.353581 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21f4be72a99416799f8ae6b57891317'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.363205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21f4be72a99416799f8ae6b57891317'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.363830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-51df45cf-6b4c-4df5-a970-513169d9a71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21f4be72a99416799f8ae6b57891317'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.370136 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1394/2780] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:42:06 2022] DELETE /identity/v3/users/b21f4be72a99416799f8ae6b57891317 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:42:06.644313 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:06.645886 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:06.660333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8611f-da15-4459-a12f-5b974684a416 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:06.733800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:06.734430 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:06.734729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:06.734998 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] PATH_INFO: `/v3/projects/559882322d6941648450f3f346d58063` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:06.736121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559882322d6941648450f3f346d58063)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:06.738015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:06.786340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559882322d6941648450f3f346d58063', 'request_id': 'req-4b762519-840a-4bf5-a721-059db34df606'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.792729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559882322d6941648450f3f346d58063', 'request_id': 'req-4b762519-840a-4bf5-a721-059db34df606'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.795001 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:06.800466 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559882322d6941648450f3f346d58063', 'request_id': 'req-4b762519-840a-4bf5-a721-059db34df606'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.813962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] The token cache is being invalidate because project 559882322d6941648450f3f346d58063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:42:06.814273 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.814932 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4b762519-840a-4bf5-a721-059db34df606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:06.816502 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1387/2781] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:42:06 2022] DELETE /identity/v3/projects/559882322d6941648450f3f346d58063 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:42:06.822303 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7b3f1-1da1-4148-a16b-2dc6f070fa2e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:06.822822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7b3f1-1da1-4148-a16b-2dc6f070fa2e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:06.822910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7b3f1-1da1-4148-a16b-2dc6f070fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:06.844401 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c1b7b3f1-1da1-4148-a16b-2dc6f070fa2e None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:42:06.845647 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c1b7b3f1-1da1-4148-a16b-2dc6f070fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:06.908210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1395/2782] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:42:06.916625 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5de68c-3d10-46d8-965d-db1afec362c9 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:06.916991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5de68c-3d10-46d8-965d-db1afec362c9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:06.917295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5de68c-3d10-46d8-965d-db1afec362c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:06.941707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9a5de68c-3d10-46d8-965d-db1afec362c9 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:42:06.942959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9a5de68c-3d10-46d8-965d-db1afec362c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:06.952254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1388/2783] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:42:06.955948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7b3f1-1da1-4148-a16b-2dc6f070fa2e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:06.966063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7b3f1-1da1-4148-a16b-2dc6f070fa2e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:06.976032 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c00f6-ff33-4c3b-8790-3313d27c78db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:06.976828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c00f6-ff33-4c3b-8790-3313d27c78db admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:06.977210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c00f6-ff33-4c3b-8790-3313d27c78db admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:06.977623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c00f6-ff33-4c3b-8790-3313d27c78db admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:06.978502 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c00f6-ff33-4c3b-8790-3313d27c78db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:42:06.978937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c00f6-ff33-4c3b-8790-3313d27c78db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:06.980668 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c00f6-ff33-4c3b-8790-3313d27c78db admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:06.998997 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1396/2784] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:42:07.000524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5de68c-3d10-46d8-965d-db1afec362c9 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:07.010759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5de68c-3d10-46d8-965d-db1afec362c9 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:07.016501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cb56a-97db-40c0-bbcf-cdc2d16a7e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:07.017022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cb56a-97db-40c0-bbcf-cdc2d16a7e7c admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:07.017304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cb56a-97db-40c0-bbcf-cdc2d16a7e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:07.017572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cb56a-97db-40c0-bbcf-cdc2d16a7e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:07.018211 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cb56a-97db-40c0-bbcf-cdc2d16a7e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:07.020848 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cb56a-97db-40c0-bbcf-cdc2d16a7e7c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:07.052484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1389/2785] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:42:06 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:42:07.056763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c00f6-ff33-4c3b-8790-3313d27c78db admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:07.068012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c00f6-ff33-4c3b-8790-3313d27c78db admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:07.135982 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fd29b-580b-4b7c-a706-c8a9d8725460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:07.136289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fd29b-580b-4b7c-a706-c8a9d8725460 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:07.136565 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fd29b-580b-4b7c-a706-c8a9d8725460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:07.136869 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fd29b-580b-4b7c-a706-c8a9d8725460 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:07.137500 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fd29b-580b-4b7c-a706-c8a9d8725460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:07.139521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fd29b-580b-4b7c-a706-c8a9d8725460 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:07.163677 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1397/2786] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:42:07 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:42:07.165128 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cb56a-97db-40c0-bbcf-cdc2d16a7e7c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:07.176510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cb56a-97db-40c0-bbcf-cdc2d16a7e7c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:07.181246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac494f6a-9168-420e-b57b-6dde0f20d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:07.181840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac494f6a-9168-420e-b57b-6dde0f20d06e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:07.182113 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac494f6a-9168-420e-b57b-6dde0f20d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:07.182379 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac494f6a-9168-420e-b57b-6dde0f20d06e admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:07.183046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac494f6a-9168-420e-b57b-6dde0f20d06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:07.184633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac494f6a-9168-420e-b57b-6dde0f20d06e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:07.194973 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1390/2787] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:42:07.198790 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fd29b-580b-4b7c-a706-c8a9d8725460 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:07.209098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fd29b-580b-4b7c-a706-c8a9d8725460 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:07.213629 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f860066-afb1-493b-8b71-06297676a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:07.214226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f860066-afb1-493b-8b71-06297676a8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:07.214503 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f860066-afb1-493b-8b71-06297676a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:07.214803 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f860066-afb1-493b-8b71-06297676a8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:07.215458 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f860066-afb1-493b-8b71-06297676a8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:07.217710 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f860066-afb1-493b-8b71-06297676a8e0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:07.231308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1398/2788] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:42:07.233357 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac494f6a-9168-420e-b57b-6dde0f20d06e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:07.247900 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac494f6a-9168-420e-b57b-6dde0f20d06e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:07.253769 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ec40b-df4b-478c-942a-a20c1417cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:07.254442 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ec40b-df4b-478c-942a-a20c1417cac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:07.254752 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ec40b-df4b-478c-942a-a20c1417cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:07.255036 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ec40b-df4b-478c-942a-a20c1417cac9 admin admin] PATH_INFO: `/v3/projects/22fa2c0ad3ab422485203285e15002ec/users/90a5f40290e2428dba6cbfbc0fa5cdbf/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:07.272185 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ec40b-df4b-478c-942a-a20c1417cac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fa2c0ad3ab422485203285e15002ec, user_id=90a5f40290e2428dba6cbfbc0fa5cdbf, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:07.275117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ec40b-df4b-478c-942a-a20c1417cac9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:07.291022 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1391/2789] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:42:07 2022] PUT /identity/v3/projects/22fa2c0ad3ab422485203285e15002ec/users/90a5f40290e2428dba6cbfbc0fa5cdbf/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:42:07.363946 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8f7f1-1779-40ce-8b2b-22d8e23ad27a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:07.364255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8f7f1-1779-40ce-8b2b-22d8e23ad27a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:07.364532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8f7f1-1779-40ce-8b2b-22d8e23ad27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:07.405043 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4fe8f7f1-1779-40ce-8b2b-22d8e23ad27a None None] MFA Rules not processed for user `90a5f40290e2428dba6cbfbc0fa5cdbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:42:07.406433 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4fe8f7f1-1779-40ce-8b2b-22d8e23ad27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:07.439756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:07.477574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1399/2790] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:42:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:42:07.489445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ec40b-df4b-478c-942a-a20c1417cac9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:07.491489 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5a7ec40b-df4b-478c-942a-a20c1417cac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:07.559254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ec40b-df4b-478c-942a-a20c1417cac9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:07.563028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f6c22-c3e5-4f18-bc5e-e2a4de82e637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:07.563632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f6c22-c3e5-4f18-bc5e-e2a4de82e637 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:07.563907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f6c22-c3e5-4f18-bc5e-e2a4de82e637 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:07.564173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f6c22-c3e5-4f18-bc5e-e2a4de82e637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:07.572580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f6c22-c3e5-4f18-bc5e-e2a4de82e637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:07.574002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f6c22-c3e5-4f18-bc5e-e2a4de82e637 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:07.583657 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1392/2791] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:42:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:42:17.474818 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=12 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:17.579846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:19.025083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8f7f1-1779-40ce-8b2b-22d8e23ad27a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:19.086159 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8f7f1-1779-40ce-8b2b-22d8e23ad27a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:19.090656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:19.091813 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:19.092084 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:19.092353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] PATH_INFO: `/v3/users/90a5f40290e2428dba6cbfbc0fa5cdbf` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:19.093457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a5f40290e2428dba6cbfbc0fa5cdbf)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:19.095407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:19.142514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a5f40290e2428dba6cbfbc0fa5cdbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.154977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a5f40290e2428dba6cbfbc0fa5cdbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.161964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a5f40290e2428dba6cbfbc0fa5cdbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.168624 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a5f40290e2428dba6cbfbc0fa5cdbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.169984 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a5f40290e2428dba6cbfbc0fa5cdbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.175724 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1400/2792] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:42:19 2022] DELETE /identity/v3/users/90a5f40290e2428dba6cbfbc0fa5cdbf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:42:19.180350 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf92c4-e0a9-4858-8111-43dc56546730 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:19.180869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf92c4-e0a9-4858-8111-43dc56546730 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:19.180869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf92c4-e0a9-4858-8111-43dc56546730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:19.199544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7caf92c4-e0a9-4858-8111-43dc56546730 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:42:19.200733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7caf92c4-e0a9-4858-8111-43dc56546730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:19.258190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1393/2793] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:42:19.268096 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:19.269540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:19.326641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b7d2b-7067-4f0b-a86b-5b36e2c7f53c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:19.330292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b1dd-050d-4a08-a57e-383fbd42d657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:19.330926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b1dd-050d-4a08-a57e-383fbd42d657 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:19.331205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b1dd-050d-4a08-a57e-383fbd42d657 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:19.331475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b1dd-050d-4a08-a57e-383fbd42d657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:19.340376 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b1dd-050d-4a08-a57e-383fbd42d657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:19.342569 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b1dd-050d-4a08-a57e-383fbd42d657 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:19.351882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1401/2794] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:42:19.625221 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf92c4-e0a9-4858-8111-43dc56546730 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:19.626662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7caf92c4-e0a9-4858-8111-43dc56546730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:19.639484 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf92c4-e0a9-4858-8111-43dc56546730 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:19.644961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:19.645593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:19.645870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:19.646138 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] PATH_INFO: `/v3/projects/22fa2c0ad3ab422485203285e15002ec` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:19.647324 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fa2c0ad3ab422485203285e15002ec)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:19.649392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:19.697984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fa2c0ad3ab422485203285e15002ec', 'request_id': 'req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.704938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fa2c0ad3ab422485203285e15002ec', 'request_id': 'req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.710308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fa2c0ad3ab422485203285e15002ec', 'request_id': 'req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.722929 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] The token cache is being invalidate because project 22fa2c0ad3ab422485203285e15002ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:42:19.723456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.724114 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c512aafa-2d4e-4488-9a91-e04cff9ca4b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:42:19.725596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1394/2795] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:42:19 2022] DELETE /identity/v3/projects/22fa2c0ad3ab422485203285e15002ec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:42:29.347727 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:29.719748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:53.693282 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b1dd-050d-4a08-a57e-383fbd42d657 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:53.694752 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0149b1dd-050d-4a08-a57e-383fbd42d657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:53.854935 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b1dd-050d-4a08-a57e-383fbd42d657 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:53.915233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:53.915800 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:53.916131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:53.916436 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:53.918176 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:53.930214 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:53.931835 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:53.942318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1402/2796] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:42:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:42:56.471906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6932ff-1614-4684-9180-7786fefcf988 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:56.472445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6932ff-1614-4684-9180-7786fefcf988 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:56.472445 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6932ff-1614-4684-9180-7786fefcf988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:56.491622 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7f6932ff-1614-4684-9180-7786fefcf988 None None] MFA Rules not processed for user `aee105e9d1ee44f985fdbac834330afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:42:56.492823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7f6932ff-1614-4684-9180-7786fefcf988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:56.548206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1395/2797] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:42:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:42:56.847582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:42:56.849113 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:56.875494 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:56.927067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20b38e-7d2e-4559-9dcb-8ebcb2f16326 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:42:56.930539 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:42:56.931171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:42:56.931447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:42:56.931739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:42:56.933447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:42:56.943308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:42:56.944725 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:42:56.953123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1403/2798] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:42:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:43:06.540327 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=25 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:06.949003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=24 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:15.828135 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6932ff-1614-4684-9180-7786fefcf988 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:43:15.837648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6932ff-1614-4684-9180-7786fefcf988 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:43:15.841124 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c46af8-bb2f-4297-84a6-57fc485d173e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:43:15.841712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c46af8-bb2f-4297-84a6-57fc485d173e service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:43:15.841986 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c46af8-bb2f-4297-84a6-57fc485d173e service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:43:15.842252 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c46af8-bb2f-4297-84a6-57fc485d173e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:43:15.844658 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b4c46af8-bb2f-4297-84a6-57fc485d173e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:43:15.929257 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c46af8-bb2f-4297-84a6-57fc485d173e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:43:15.930594 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c46af8-bb2f-4297-84a6-57fc485d173e service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:43:15.948968 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1396/2799] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:43:21.938459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:43:21.940207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:43:21.957741 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba32773-cf4c-4738-98f5-c997cbe5b9ba service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:43:21.962563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:43:21.963434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:43:21.963781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:43:21.964126 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] PATH_INFO: `/v3/users/814055c34d8741c396a165c172c0b5df` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:43:21.965339 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814055c34d8741c396a165c172c0b5df)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:43:21.967333 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:43:22.024879 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814055c34d8741c396a165c172c0b5df'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.037228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814055c34d8741c396a165c172c0b5df'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.044231 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814055c34d8741c396a165c172c0b5df'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.051763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814055c34d8741c396a165c172c0b5df'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.052463 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814055c34d8741c396a165c172c0b5df'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.058526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1404/2800] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:43:21 2022] DELETE /identity/v3/users/814055c34d8741c396a165c172c0b5df => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:43:22.233409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c46af8-bb2f-4297-84a6-57fc485d173e service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:43:22.243636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c46af8-bb2f-4297-84a6-57fc485d173e service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:43:22.302438 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:43:22.303017 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:43:22.303295 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:43:22.303566 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] PATH_INFO: `/v3/projects/a5cf6948c3084f82b658188fbefba128` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:43:22.304685 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5cf6948c3084f82b658188fbefba128)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:43:22.306585 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:43:22.351799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5cf6948c3084f82b658188fbefba128', 'request_id': 'req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.359344 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5cf6948c3084f82b658188fbefba128', 'request_id': 'req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.364925 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5cf6948c3084f82b658188fbefba128', 'request_id': 'req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.368491 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:22.379736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] The token cache is being invalidate because project a5cf6948c3084f82b658188fbefba128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:43:22.380081 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.380997 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.382711 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1397/2801] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:43:22 2022] DELETE /identity/v3/projects/a5cf6948c3084f82b658188fbefba128 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:43:22.386632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:43:22.388067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:43:22.401753 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848947-207a-4925-b387-71502117d2b4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:43:22.457739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:43:22.458296 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:43:22.458574 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:43:22.458875 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] PATH_INFO: `/v3/users/d2aad09d0e27492083b3acda3d5772ef` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:43:22.460001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2aad09d0e27492083b3acda3d5772ef)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:43:22.461926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:43:22.506862 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2aad09d0e27492083b3acda3d5772ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.519102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2aad09d0e27492083b3acda3d5772ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.525846 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2aad09d0e27492083b3acda3d5772ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.527516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:22.533992 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2aad09d0e27492083b3acda3d5772ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.534926 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2aad09d0e27492083b3acda3d5772ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.541434 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1405/2802] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:43:22 2022] DELETE /identity/v3/users/d2aad09d0e27492083b3acda3d5772ef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:43:22.712785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:43:22.714346 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:43:22.729351 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96880f3-5b84-4b63-8f2a-75df77bb5f2d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:43:22.787804 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:43:22.788426 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:43:22.788703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:43:22.788972 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] PATH_INFO: `/v3/projects/f55f2135126043ca8f903004f5bf521b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:43:22.790074 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55f2135126043ca8f903004f5bf521b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:43:22.791988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:43:22.836819 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55f2135126043ca8f903004f5bf521b', 'request_id': 'req-adea8e47-d60e-4234-a251-a67edea5519f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.842790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55f2135126043ca8f903004f5bf521b', 'request_id': 'req-adea8e47-d60e-4234-a251-a67edea5519f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.848269 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55f2135126043ca8f903004f5bf521b', 'request_id': 'req-adea8e47-d60e-4234-a251-a67edea5519f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.862700 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] The token cache is being invalidate because project f55f2135126043ca8f903004f5bf521b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:43:22.863003 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.863621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:22.865117 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1398/2803] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:43:22 2022] DELETE /identity/v3/projects/f55f2135126043ca8f903004f5bf521b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:43:32.538153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:32.858790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:59.352332 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:43:59.353700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:43:59.368799 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c587633-28e0-45fb-8061-1807d1096bbe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:43:59.434826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:43:59.435470 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:43:59.435840 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:43:59.436041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] PATH_INFO: `/v3/users/aee105e9d1ee44f985fdbac834330afd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:43:59.437201 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee105e9d1ee44f985fdbac834330afd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:43:59.439186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:43:59.489078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee105e9d1ee44f985fdbac834330afd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.503070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee105e9d1ee44f985fdbac834330afd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.510205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee105e9d1ee44f985fdbac834330afd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.518886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee105e9d1ee44f985fdbac834330afd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.519530 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71e84de8-802d-4fad-9b43-c8d98e17c15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee105e9d1ee44f985fdbac834330afd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.526024 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1406/2804] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:43:59 2022] DELETE /identity/v3/users/aee105e9d1ee44f985fdbac834330afd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:43:59.710427 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:43:59.711977 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:43:59.726909 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea8e47-d60e-4234-a251-a67edea5519f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:43:59.790156 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:43:59.790740 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:43:59.791019 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:43:59.791287 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] PATH_INFO: `/v3/projects/9cdbc0f0a21740d59fcbfee3b40605bf` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:43:59.792403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cdbc0f0a21740d59fcbfee3b40605bf)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:43:59.794356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:43:59.843259 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cdbc0f0a21740d59fcbfee3b40605bf', 'request_id': 'req-fc0245e1-3528-4734-abbf-25b96becbba7'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.849258 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cdbc0f0a21740d59fcbfee3b40605bf', 'request_id': 'req-fc0245e1-3528-4734-abbf-25b96becbba7'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.854707 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cdbc0f0a21740d59fcbfee3b40605bf', 'request_id': 'req-fc0245e1-3528-4734-abbf-25b96becbba7'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.867049 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] The token cache is being invalidate because project 9cdbc0f0a21740d59fcbfee3b40605bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:43:59.867328 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.867946 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fc0245e1-3528-4734-abbf-25b96becbba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:43:59.869478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1399/2805] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:43:59 2022] DELETE /identity/v3/projects/9cdbc0f0a21740d59fcbfee3b40605bf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:43:59.875149 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e9315-9fe4-4450-93b2-63c05680b304 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:43:59.875428 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e9315-9fe4-4450-93b2-63c05680b304 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:43:59.875701 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e9315-9fe4-4450-93b2-63c05680b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:43:59.934169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cc4e9315-9fe4-4450-93b2-63c05680b304 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:43:59.935406 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cc4e9315-9fe4-4450-93b2-63c05680b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:43:59.978774 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:59.995723 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1407/2806] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:00.004261 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d91af-61e8-4de9-a94f-d34cb4a2a747 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.004542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d91af-61e8-4de9-a94f-d34cb4a2a747 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.004816 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d91af-61e8-4de9-a94f-d34cb4a2a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.025318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-752d91af-61e8-4de9-a94f-d34cb4a2a747 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:00.026504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-752d91af-61e8-4de9-a94f-d34cb4a2a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:00.034569 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1400/2807] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:00.038636 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e9315-9fe4-4450-93b2-63c05680b304 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.048359 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e9315-9fe4-4450-93b2-63c05680b304 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.055485 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2603c33-25c3-4c17-bfe3-1a938e403845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.056140 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2603c33-25c3-4c17-bfe3-1a938e403845 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.056512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2603c33-25c3-4c17-bfe3-1a938e403845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.056867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2603c33-25c3-4c17-bfe3-1a938e403845 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.057607 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2603c33-25c3-4c17-bfe3-1a938e403845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:44:00.057988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2603c33-25c3-4c17-bfe3-1a938e403845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.059702 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2603c33-25c3-4c17-bfe3-1a938e403845 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.071770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1408/2808] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:44:00.076102 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d91af-61e8-4de9-a94f-d34cb4a2a747 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.085680 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d91af-61e8-4de9-a94f-d34cb4a2a747 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.090228 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad4ad7-9ef5-4921-ab54-eaa78090227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.090846 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad4ad7-9ef5-4921-ab54-eaa78090227d admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.091123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad4ad7-9ef5-4921-ab54-eaa78090227d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.091390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad4ad7-9ef5-4921-ab54-eaa78090227d admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.092014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad4ad7-9ef5-4921-ab54-eaa78090227d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.093892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad4ad7-9ef5-4921-ab54-eaa78090227d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.121318 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1401/2809] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:00 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:00.126203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2603c33-25c3-4c17-bfe3-1a938e403845 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.136540 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2603c33-25c3-4c17-bfe3-1a938e403845 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.193078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15401f8-b1c0-43a4-9a89-9c5a859fe663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.193681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15401f8-b1c0-43a4-9a89-9c5a859fe663 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.193955 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15401f8-b1c0-43a4-9a89-9c5a859fe663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.194222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15401f8-b1c0-43a4-9a89-9c5a859fe663 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.194885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15401f8-b1c0-43a4-9a89-9c5a859fe663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.196796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15401f8-b1c0-43a4-9a89-9c5a859fe663 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.219114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1409/2810] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:00 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:00.223241 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad4ad7-9ef5-4921-ab54-eaa78090227d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.233912 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad4ad7-9ef5-4921-ab54-eaa78090227d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.238433 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ed6c4-3fab-4341-b4fc-0f362efe66f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.239058 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ed6c4-3fab-4341-b4fc-0f362efe66f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.239338 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ed6c4-3fab-4341-b4fc-0f362efe66f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.239612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ed6c4-3fab-4341-b4fc-0f362efe66f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.240246 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ed6c4-3fab-4341-b4fc-0f362efe66f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.241860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ed6c4-3fab-4341-b4fc-0f362efe66f6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.252399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1402/2811] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:44:00.256215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15401f8-b1c0-43a4-9a89-9c5a859fe663 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.266614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15401f8-b1c0-43a4-9a89-9c5a859fe663 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.271192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da3a02-4582-42c1-9214-7b6a71cc5c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.271775 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3a02-4582-42c1-9214-7b6a71cc5c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.272051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3a02-4582-42c1-9214-7b6a71cc5c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.272318 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3a02-4582-42c1-9214-7b6a71cc5c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.272944 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da3a02-4582-42c1-9214-7b6a71cc5c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.274525 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da3a02-4582-42c1-9214-7b6a71cc5c75 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.285259 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1410/2812] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:00.289384 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ed6c4-3fab-4341-b4fc-0f362efe66f6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.299993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ed6c4-3fab-4341-b4fc-0f362efe66f6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.304524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a39b68-cad0-456f-b715-cef8d1105c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.305617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a39b68-cad0-456f-b715-cef8d1105c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.305617 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a39b68-cad0-456f-b715-cef8d1105c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.305885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a39b68-cad0-456f-b715-cef8d1105c10 admin admin] PATH_INFO: `/v3/projects/f0c843c2e096420c8a9c142d0209490c/users/91247442d2c24cec973f01f5f72b7811/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.320939 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a39b68-cad0-456f-b715-cef8d1105c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c843c2e096420c8a9c142d0209490c, user_id=91247442d2c24cec973f01f5f72b7811, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.323618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a39b68-cad0-456f-b715-cef8d1105c10 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.336500 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1403/2813] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:00 2022] PUT /identity/v3/projects/f0c843c2e096420c8a9c142d0209490c/users/91247442d2c24cec973f01f5f72b7811/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:44:00.348197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4bb0-7b02-4c4a-8782-5cfdcb38e0ed None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.348601 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4bb0-7b02-4c4a-8782-5cfdcb38e0ed None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.348970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4bb0-7b02-4c4a-8782-5cfdcb38e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.378459 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e7af4bb0-7b02-4c4a-8782-5cfdcb38e0ed None None] MFA Rules not processed for user `91247442d2c24cec973f01f5f72b7811`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:00.379756 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e7af4bb0-7b02-4c4a-8782-5cfdcb38e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:00.447629 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1411/2814] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:00.452121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a39b68-cad0-456f-b715-cef8d1105c10 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.480795 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:00.515481 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a39b68-cad0-456f-b715-cef8d1105c10 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.520123 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8d84-dc5b-457e-9a22-b595f1f34902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.520702 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8d84-dc5b-457e-9a22-b595f1f34902 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.520978 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8d84-dc5b-457e-9a22-b595f1f34902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.521249 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8d84-dc5b-457e-9a22-b595f1f34902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.521879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f8d84-dc5b-457e-9a22-b595f1f34902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.523814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f8d84-dc5b-457e-9a22-b595f1f34902 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.549610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1404/2815] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:00 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:00.553653 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4bb0-7b02-4c4a-8782-5cfdcb38e0ed None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.565185 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4bb0-7b02-4c4a-8782-5cfdcb38e0ed None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.606098 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:00.622929 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60b9f5-c5a7-43df-a317-096a1c0a0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.623812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60b9f5-c5a7-43df-a317-096a1c0a0a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.623812 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60b9f5-c5a7-43df-a317-096a1c0a0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.624072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60b9f5-c5a7-43df-a317-096a1c0a0a41 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.624703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60b9f5-c5a7-43df-a317-096a1c0a0a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.626588 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60b9f5-c5a7-43df-a317-096a1c0a0a41 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.647808 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1412/2816] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:00 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:00.651867 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8d84-dc5b-457e-9a22-b595f1f34902 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.662590 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8d84-dc5b-457e-9a22-b595f1f34902 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.667340 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e99ef4-2554-4396-aba9-47cc6c36a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.667935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99ef4-2554-4396-aba9-47cc6c36a79d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.668215 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99ef4-2554-4396-aba9-47cc6c36a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.668487 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99ef4-2554-4396-aba9-47cc6c36a79d admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.669131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e99ef4-2554-4396-aba9-47cc6c36a79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.671378 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e99ef4-2554-4396-aba9-47cc6c36a79d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.681917 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1405/2817] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:00.686426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60b9f5-c5a7-43df-a317-096a1c0a0a41 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.696146 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60b9f5-c5a7-43df-a317-096a1c0a0a41 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.700771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683a1b1-c119-461f-8115-75f2c156ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.701620 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683a1b1-c119-461f-8115-75f2c156ab39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.701894 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683a1b1-c119-461f-8115-75f2c156ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.702026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683a1b1-c119-461f-8115-75f2c156ab39 admin admin] PATH_INFO: `/v3/projects/843771b3a6324fffbcb0425ae7247a93/users/763b4987c2f24713a8b630c39cc084fd/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.716613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683a1b1-c119-461f-8115-75f2c156ab39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843771b3a6324fffbcb0425ae7247a93, user_id=763b4987c2f24713a8b630c39cc084fd, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.719777 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683a1b1-c119-461f-8115-75f2c156ab39 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.732234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1413/2818] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:00 2022] PUT /identity/v3/projects/843771b3a6324fffbcb0425ae7247a93/users/763b4987c2f24713a8b630c39cc084fd/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:00.736938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e99ef4-2554-4396-aba9-47cc6c36a79d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.746676 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e99ef4-2554-4396-aba9-47cc6c36a79d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.801572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128475a-8f3e-46c2-ac2e-9be6f3ffdaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.802101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128475a-8f3e-46c2-ac2e-9be6f3ffdaac admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.802380 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128475a-8f3e-46c2-ac2e-9be6f3ffdaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.802650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128475a-8f3e-46c2-ac2e-9be6f3ffdaac admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.803314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128475a-8f3e-46c2-ac2e-9be6f3ffdaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.804899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128475a-8f3e-46c2-ac2e-9be6f3ffdaac admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.814549 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1406/2819] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:00.818730 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683a1b1-c119-461f-8115-75f2c156ab39 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.828823 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683a1b1-c119-461f-8115-75f2c156ab39 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:00.833410 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015e4a9-ae60-4422-8585-72dd6c73ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:00.834049 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015e4a9-ae60-4422-8585-72dd6c73ca25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.834326 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015e4a9-ae60-4422-8585-72dd6c73ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.834595 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015e4a9-ae60-4422-8585-72dd6c73ca25 admin admin] PATH_INFO: `/v3/projects/843771b3a6324fffbcb0425ae7247a93/users/763b4987c2f24713a8b630c39cc084fd/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.836547 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015e4a9-ae60-4422-8585-72dd6c73ca25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843771b3a6324fffbcb0425ae7247a93, user_id=763b4987c2f24713a8b630c39cc084fd, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:00.839241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015e4a9-ae60-4422-8585-72dd6c73ca25 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:00.849613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1414/2820] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:00 2022] PUT /identity/v3/projects/843771b3a6324fffbcb0425ae7247a93/users/763b4987c2f24713a8b630c39cc084fd/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:00.860249 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e34d0-837c-48a0-b5f2-115dc99b9cf0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:00.860532 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e34d0-837c-48a0-b5f2-115dc99b9cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:00.860807 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e34d0-837c-48a0-b5f2-115dc99b9cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:00.887943 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-796e34d0-837c-48a0-b5f2-115dc99b9cf0 None None] MFA Rules not processed for user `763b4987c2f24713a8b630c39cc084fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:00.889178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-796e34d0-837c-48a0-b5f2-115dc99b9cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:00.961067 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1407/2821] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:00.972938 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015e4a9-ae60-4422-8585-72dd6c73ca25 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:00.974637 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a015e4a9-ae60-4422-8585-72dd6c73ca25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:01.052596 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015e4a9-ae60-4422-8585-72dd6c73ca25 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:01.056155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37cc8f-c948-4eaa-bf04-5543ba079057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:01.056748 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37cc8f-c948-4eaa-bf04-5543ba079057 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:01.057020 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37cc8f-c948-4eaa-bf04-5543ba079057 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:01.057287 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37cc8f-c948-4eaa-bf04-5543ba079057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:01.066219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37cc8f-c948-4eaa-bf04-5543ba079057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:01.067681 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37cc8f-c948-4eaa-bf04-5543ba079057 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:01.077369 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1415/2822] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:01.121206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e34d0-837c-48a0-b5f2-115dc99b9cf0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:01.122991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-796e34d0-837c-48a0-b5f2-115dc99b9cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:01.137814 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e34d0-837c-48a0-b5f2-115dc99b9cf0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:01.142576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49e03c-f261-4d37-88d2-e4d7eed1dbaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:01.143199 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49e03c-f261-4d37-88d2-e4d7eed1dbaf service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:01.143474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49e03c-f261-4d37-88d2-e4d7eed1dbaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:01.143741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49e03c-f261-4d37-88d2-e4d7eed1dbaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:01.163600 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:01.202534 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49e03c-f261-4d37-88d2-e4d7eed1dbaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:01.203994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49e03c-f261-4d37-88d2-e4d7eed1dbaf service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:01.212855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1408/2823] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:04.488959 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37cc8f-c948-4eaa-bf04-5543ba079057 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:04.550324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37cc8f-c948-4eaa-bf04-5543ba079057 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:04.555074 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:04.555693 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:04.555971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:04.556244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] PATH_INFO: `/v3/users/91247442d2c24cec973f01f5f72b7811` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:04.557353 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91247442d2c24cec973f01f5f72b7811)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:04.559323 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:04.582482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:04.607420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91247442d2c24cec973f01f5f72b7811'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:04.619305 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91247442d2c24cec973f01f5f72b7811'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:04.626836 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91247442d2c24cec973f01f5f72b7811'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:04.634009 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91247442d2c24cec973f01f5f72b7811'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:04.634631 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91247442d2c24cec973f01f5f72b7811'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:04.641115 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1416/2824] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:04 2022] DELETE /identity/v3/users/91247442d2c24cec973f01f5f72b7811 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:04.645570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1a69e-57ce-4538-8ae9-897ea68bda2b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:04.646084 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1a69e-57ce-4538-8ae9-897ea68bda2b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:04.646190 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1a69e-57ce-4538-8ae9-897ea68bda2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:04.664632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2af1a69e-57ce-4538-8ae9-897ea68bda2b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:04.665860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2af1a69e-57ce-4538-8ae9-897ea68bda2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:04.725855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1409/2825] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:04.735948 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:04.737418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:04.794883 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7274efd-0540-4973-ad11-f2ba8578e8c0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:04.799374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0bf75-1727-440a-bdca-8f204470c6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:04.799969 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0bf75-1727-440a-bdca-8f204470c6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:04.800246 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0bf75-1727-440a-bdca-8f204470c6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:04.800512 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0bf75-1727-440a-bdca-8f204470c6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:04.809431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0bf75-1727-440a-bdca-8f204470c6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:04.811672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0bf75-1727-440a-bdca-8f204470c6b4 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:04.821158 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1417/2826] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:05.082385 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1a69e-57ce-4538-8ae9-897ea68bda2b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:05.085653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2af1a69e-57ce-4538-8ae9-897ea68bda2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:05.098509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1a69e-57ce-4538-8ae9-897ea68bda2b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:05.103914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:05.104553 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:05.104838 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:05.105110 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] PATH_INFO: `/v3/projects/f0c843c2e096420c8a9c142d0209490c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:05.106263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c843c2e096420c8a9c142d0209490c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:05.109030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:05.159733 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c843c2e096420c8a9c142d0209490c', 'request_id': 'req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.165936 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c843c2e096420c8a9c142d0209490c', 'request_id': 'req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.172142 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c843c2e096420c8a9c142d0209490c', 'request_id': 'req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.184554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] The token cache is being invalidate because project f0c843c2e096420c8a9c142d0209490c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:05.184841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.185468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.187210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1410/2827] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:05 2022] DELETE /identity/v3/projects/f0c843c2e096420c8a9c142d0209490c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:05.191200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0bf75-1727-440a-bdca-8f204470c6b4 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:05.202715 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0bf75-1727-440a-bdca-8f204470c6b4 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:05.258885 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:05.259502 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:05.259830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:05.260044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] PATH_INFO: `/v3/users/763b4987c2f24713a8b630c39cc084fd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:05.261153 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=763b4987c2f24713a8b630c39cc084fd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:05.263104 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:05.306947 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:05.310028 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763b4987c2f24713a8b630c39cc084fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.324398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763b4987c2f24713a8b630c39cc084fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.331347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763b4987c2f24713a8b630c39cc084fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.338705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763b4987c2f24713a8b630c39cc084fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.339433 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d8e4cf2d-4a9c-43bb-8ce8-dd05f0c082ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763b4987c2f24713a8b630c39cc084fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.345828 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1418/2828] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:05 2022] DELETE /identity/v3/users/763b4987c2f24713a8b630c39cc084fd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:05.617104 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:05.618650 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:05.632759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f75e6-ef9d-4aa7-b47b-815e354e876d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:05.677519 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:05.693723 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:05.694359 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:05.694637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:05.694940 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] PATH_INFO: `/v3/projects/843771b3a6324fffbcb0425ae7247a93` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:05.696637 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843771b3a6324fffbcb0425ae7247a93)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:05.698572 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:05.745874 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843771b3a6324fffbcb0425ae7247a93', 'request_id': 'req-89bad655-5b31-4804-8b82-926ccb9ea303'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.752835 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843771b3a6324fffbcb0425ae7247a93', 'request_id': 'req-89bad655-5b31-4804-8b82-926ccb9ea303'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.758206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843771b3a6324fffbcb0425ae7247a93', 'request_id': 'req-89bad655-5b31-4804-8b82-926ccb9ea303'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.771206 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] The token cache is being invalidate because project 843771b3a6324fffbcb0425ae7247a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:05.771492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.772115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89bad655-5b31-4804-8b82-926ccb9ea303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:05.773597 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1411/2829] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:05 2022] DELETE /identity/v3/projects/843771b3a6324fffbcb0425ae7247a93 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:05.778494 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aec6c-e863-45ee-b188-2af26db82751 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:05.779021 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aec6c-e863-45ee-b188-2af26db82751 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:05.779129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aec6c-e863-45ee-b188-2af26db82751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:05.799575 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d87aec6c-e863-45ee-b188-2af26db82751 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:05.800689 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d87aec6c-e863-45ee-b188-2af26db82751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:05.859418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1419/2830] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:44:05.867052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dae3d-1ec9-4694-a673-13c82feff05b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:05.867335 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dae3d-1ec9-4694-a673-13c82feff05b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:05.867610 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dae3d-1ec9-4694-a673-13c82feff05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:05.887589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b92dae3d-1ec9-4694-a673-13c82feff05b None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:05.888787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b92dae3d-1ec9-4694-a673-13c82feff05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:05.897272 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1412/2831] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:05.901343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aec6c-e863-45ee-b188-2af26db82751 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:05.910927 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aec6c-e863-45ee-b188-2af26db82751 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:05.915411 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb96dde-7e1a-43e5-96ff-b58b20d4ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:05.915993 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb96dde-7e1a-43e5-96ff-b58b20d4ef8a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:05.916265 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb96dde-7e1a-43e5-96ff-b58b20d4ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:05.916532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb96dde-7e1a-43e5-96ff-b58b20d4ef8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:05.917181 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb96dde-7e1a-43e5-96ff-b58b20d4ef8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:44:05.917468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb96dde-7e1a-43e5-96ff-b58b20d4ef8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:05.919110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb96dde-7e1a-43e5-96ff-b58b20d4ef8a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:05.930523 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1420/2832] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:44:05.934642 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dae3d-1ec9-4694-a673-13c82feff05b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:05.944457 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dae3d-1ec9-4694-a673-13c82feff05b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:05.949078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd11f6d-cd64-45c2-80d7-1e19d597882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:05.949662 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd11f6d-cd64-45c2-80d7-1e19d597882f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:05.949941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd11f6d-cd64-45c2-80d7-1e19d597882f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:05.950210 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd11f6d-cd64-45c2-80d7-1e19d597882f admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:05.950869 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd11f6d-cd64-45c2-80d7-1e19d597882f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:05.953302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd11f6d-cd64-45c2-80d7-1e19d597882f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:05.979922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1413/2833] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:05 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:05.984291 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb96dde-7e1a-43e5-96ff-b58b20d4ef8a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:05.994228 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb96dde-7e1a-43e5-96ff-b58b20d4ef8a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.051398 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912465e0-360f-4e72-9a79-5d776a234dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.051921 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912465e0-360f-4e72-9a79-5d776a234dbe admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.052202 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912465e0-360f-4e72-9a79-5d776a234dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.052478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912465e0-360f-4e72-9a79-5d776a234dbe admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.053110 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912465e0-360f-4e72-9a79-5d776a234dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.055089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912465e0-360f-4e72-9a79-5d776a234dbe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.077167 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1421/2834] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:05 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:44:06.081253 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd11f6d-cd64-45c2-80d7-1e19d597882f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.091408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd11f6d-cd64-45c2-80d7-1e19d597882f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.096068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af9475-31b0-4d6e-9613-9fb0e279c40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.096659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af9475-31b0-4d6e-9613-9fb0e279c40d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.096935 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af9475-31b0-4d6e-9613-9fb0e279c40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.097205 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af9475-31b0-4d6e-9613-9fb0e279c40d admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.097842 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af9475-31b0-4d6e-9613-9fb0e279c40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.099580 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af9475-31b0-4d6e-9613-9fb0e279c40d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.109635 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1414/2835] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:06.113613 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912465e0-360f-4e72-9a79-5d776a234dbe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.124438 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912465e0-360f-4e72-9a79-5d776a234dbe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.129204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19362c86-38c2-455a-85be-64414ca44f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.129802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19362c86-38c2-455a-85be-64414ca44f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.130070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19362c86-38c2-455a-85be-64414ca44f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.130347 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19362c86-38c2-455a-85be-64414ca44f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.131022 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19362c86-38c2-455a-85be-64414ca44f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.132623 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19362c86-38c2-455a-85be-64414ca44f6f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.143707 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1422/2836] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:06.147798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af9475-31b0-4d6e-9613-9fb0e279c40d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.157632 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af9475-31b0-4d6e-9613-9fb0e279c40d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.162197 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3861f57-cfae-4e92-88f4-08fc7f092755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.162865 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3861f57-cfae-4e92-88f4-08fc7f092755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.163144 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3861f57-cfae-4e92-88f4-08fc7f092755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.163417 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3861f57-cfae-4e92-88f4-08fc7f092755 admin admin] PATH_INFO: `/v3/projects/be2fdab357d645e49aebe13242f9a48f/users/906d945b7e2e4d22a23dc850c840f62a/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.177768 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3861f57-cfae-4e92-88f4-08fc7f092755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2fdab357d645e49aebe13242f9a48f, user_id=906d945b7e2e4d22a23dc850c840f62a, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.180449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3861f57-cfae-4e92-88f4-08fc7f092755 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.193300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1415/2837] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:06 2022] PUT /identity/v3/projects/be2fdab357d645e49aebe13242f9a48f/users/906d945b7e2e4d22a23dc850c840f62a/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:06.205225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02772924-634d-40a4-ac48-8439210a4f1e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.205511 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02772924-634d-40a4-ac48-8439210a4f1e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.205784 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02772924-634d-40a4-ac48-8439210a4f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.234234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-02772924-634d-40a4-ac48-8439210a4f1e None None] MFA Rules not processed for user `906d945b7e2e4d22a23dc850c840f62a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:06.235460 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-02772924-634d-40a4-ac48-8439210a4f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:06.248108 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:06.301283 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1423/2838] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:06.305810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3861f57-cfae-4e92-88f4-08fc7f092755 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.366143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3861f57-cfae-4e92-88f4-08fc7f092755 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.370696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ac4ce-322d-427a-9d6c-04421d00ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.371292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ac4ce-322d-427a-9d6c-04421d00ce85 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.371568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ac4ce-322d-427a-9d6c-04421d00ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.371843 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ac4ce-322d-427a-9d6c-04421d00ce85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.372716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ac4ce-322d-427a-9d6c-04421d00ce85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.375641 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ac4ce-322d-427a-9d6c-04421d00ce85 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.390570 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:06.403984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1416/2839] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:06 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:06.408105 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02772924-634d-40a4-ac48-8439210a4f1e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.418617 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02772924-634d-40a4-ac48-8439210a4f1e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.474130 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bebdda-1946-4631-a65f-a413f39b1e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.474801 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bebdda-1946-4631-a65f-a413f39b1e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.475083 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bebdda-1946-4631-a65f-a413f39b1e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.475352 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bebdda-1946-4631-a65f-a413f39b1e39 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.475965 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bebdda-1946-4631-a65f-a413f39b1e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.477873 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bebdda-1946-4631-a65f-a413f39b1e39 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.500721 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1424/2840] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:06 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:06.504897 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ac4ce-322d-427a-9d6c-04421d00ce85 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.515403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ac4ce-322d-427a-9d6c-04421d00ce85 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.520014 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542ffd0-7f1a-4c30-9db4-afad68ef5f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.520604 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ffd0-7f1a-4c30-9db4-afad68ef5f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.520883 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ffd0-7f1a-4c30-9db4-afad68ef5f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.521157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ffd0-7f1a-4c30-9db4-afad68ef5f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.521791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542ffd0-7f1a-4c30-9db4-afad68ef5f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.523447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542ffd0-7f1a-4c30-9db4-afad68ef5f3f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.533830 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1417/2841] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:06.537704 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bebdda-1946-4631-a65f-a413f39b1e39 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.548065 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bebdda-1946-4631-a65f-a413f39b1e39 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.552638 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371401f9-5971-4691-a8c5-05d73efb17c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.553221 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371401f9-5971-4691-a8c5-05d73efb17c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.553496 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371401f9-5971-4691-a8c5-05d73efb17c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.553767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371401f9-5971-4691-a8c5-05d73efb17c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.554396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371401f9-5971-4691-a8c5-05d73efb17c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.556062 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371401f9-5971-4691-a8c5-05d73efb17c7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.566337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1425/2842] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:06.570317 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542ffd0-7f1a-4c30-9db4-afad68ef5f3f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.580057 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542ffd0-7f1a-4c30-9db4-afad68ef5f3f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.584571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bed0a-2860-4cb6-86d0-309381391f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.585203 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bed0a-2860-4cb6-86d0-309381391f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.585477 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bed0a-2860-4cb6-86d0-309381391f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.585745 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bed0a-2860-4cb6-86d0-309381391f4b admin admin] PATH_INFO: `/v3/projects/9151b7f8b98b43a7a155881ff68a293d/users/7c6f6586ad50417d8e3b0b31be5a7506/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.600412 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bed0a-2860-4cb6-86d0-309381391f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9151b7f8b98b43a7a155881ff68a293d, user_id=7c6f6586ad50417d8e3b0b31be5a7506, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.603050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bed0a-2860-4cb6-86d0-309381391f4b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.616296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1418/2843] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:06 2022] PUT /identity/v3/projects/9151b7f8b98b43a7a155881ff68a293d/users/7c6f6586ad50417d8e3b0b31be5a7506/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:06.626654 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613076df-5399-4418-9809-6d32e0f7f66d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.626970 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613076df-5399-4418-9809-6d32e0f7f66d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.627247 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613076df-5399-4418-9809-6d32e0f7f66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.653838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-613076df-5399-4418-9809-6d32e0f7f66d None None] MFA Rules not processed for user `7c6f6586ad50417d8e3b0b31be5a7506`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:06.655582 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-613076df-5399-4418-9809-6d32e0f7f66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:06.720483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1426/2844] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:06.724934 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bed0a-2860-4cb6-86d0-309381391f4b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.785515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bed0a-2860-4cb6-86d0-309381391f4b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.790121 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb3031-ebdd-4e41-91b6-e35e91f0f996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.790741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb3031-ebdd-4e41-91b6-e35e91f0f996 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.791021 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb3031-ebdd-4e41-91b6-e35e91f0f996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.791289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb3031-ebdd-4e41-91b6-e35e91f0f996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.791914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb3031-ebdd-4e41-91b6-e35e91f0f996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.793823 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb3031-ebdd-4e41-91b6-e35e91f0f996 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.821083 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1419/2845] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:06 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:44:06.825219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613076df-5399-4418-9809-6d32e0f7f66d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.836210 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613076df-5399-4418-9809-6d32e0f7f66d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.855957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:06.894160 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b3938-e867-45a6-ba37-f10380402743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.894793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b3938-e867-45a6-ba37-f10380402743 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.895073 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b3938-e867-45a6-ba37-f10380402743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.895343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b3938-e867-45a6-ba37-f10380402743 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.896001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b3938-e867-45a6-ba37-f10380402743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.897910 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b3938-e867-45a6-ba37-f10380402743 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.918395 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1427/2846] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:06 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:44:06.923092 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb3031-ebdd-4e41-91b6-e35e91f0f996 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.933023 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb3031-ebdd-4e41-91b6-e35e91f0f996 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.937545 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3608f-b271-4d70-b9c0-febbc731e761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.938134 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3608f-b271-4d70-b9c0-febbc731e761 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.938408 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3608f-b271-4d70-b9c0-febbc731e761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.938703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3608f-b271-4d70-b9c0-febbc731e761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.939345 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3608f-b271-4d70-b9c0-febbc731e761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.940913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3608f-b271-4d70-b9c0-febbc731e761 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:06.951191 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1420/2847] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:06.955170 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b3938-e867-45a6-ba37-f10380402743 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:06.965114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b3938-e867-45a6-ba37-f10380402743 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:06.970302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beecd6-fb83-4e39-9218-c0b985621734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:06.970971 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beecd6-fb83-4e39-9218-c0b985621734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:06.971257 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beecd6-fb83-4e39-9218-c0b985621734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:06.971532 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beecd6-fb83-4e39-9218-c0b985621734 admin admin] PATH_INFO: `/v3/projects/c87438663212455fb47c5b62ae1add65/users/eacc8c7b42614c3f99123559994f25ed/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:06.986445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5beecd6-fb83-4e39-9218-c0b985621734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87438663212455fb47c5b62ae1add65, user_id=eacc8c7b42614c3f99123559994f25ed, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:06.989363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5beecd6-fb83-4e39-9218-c0b985621734 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:07.002998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1428/2848] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:06 2022] PUT /identity/v3/projects/c87438663212455fb47c5b62ae1add65/users/eacc8c7b42614c3f99123559994f25ed/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:07.007055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3608f-b271-4d70-b9c0-febbc731e761 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:07.017627 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3608f-b271-4d70-b9c0-febbc731e761 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:07.072847 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125eea1-0a2e-4bef-b09d-0ec3eca96a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:07.073391 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125eea1-0a2e-4bef-b09d-0ec3eca96a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:07.073674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125eea1-0a2e-4bef-b09d-0ec3eca96a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:07.073948 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125eea1-0a2e-4bef-b09d-0ec3eca96a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:07.074584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125eea1-0a2e-4bef-b09d-0ec3eca96a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:07.076237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125eea1-0a2e-4bef-b09d-0ec3eca96a9b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:07.086220 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1421/2849] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:07.090328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beecd6-fb83-4e39-9218-c0b985621734 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:07.101207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beecd6-fb83-4e39-9218-c0b985621734 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:07.105782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3e114-fd39-4097-b60e-5713a78bbd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:07.106429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3e114-fd39-4097-b60e-5713a78bbd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:07.106726 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3e114-fd39-4097-b60e-5713a78bbd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:07.107001 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3e114-fd39-4097-b60e-5713a78bbd54 admin admin] PATH_INFO: `/v3/projects/c87438663212455fb47c5b62ae1add65/users/eacc8c7b42614c3f99123559994f25ed/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:07.109124 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3e114-fd39-4097-b60e-5713a78bbd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87438663212455fb47c5b62ae1add65, user_id=eacc8c7b42614c3f99123559994f25ed, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:07.111804 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3e114-fd39-4097-b60e-5713a78bbd54 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:07.121692 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1429/2850] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:07 2022] PUT /identity/v3/projects/c87438663212455fb47c5b62ae1add65/users/eacc8c7b42614c3f99123559994f25ed/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:07.132178 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961be53-413c-4164-810a-962170825d0a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:07.132474 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961be53-413c-4164-810a-962170825d0a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:07.132754 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961be53-413c-4164-810a-962170825d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:07.161736 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6961be53-413c-4164-810a-962170825d0a None None] MFA Rules not processed for user `eacc8c7b42614c3f99123559994f25ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:07.162991 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6961be53-413c-4164-810a-962170825d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:07.180815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:07.233462 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1422/2851] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:44:07.244416 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3e114-fd39-4097-b60e-5713a78bbd54 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:07.246169 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a4c3e114-fd39-4097-b60e-5713a78bbd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:07.303222 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3e114-fd39-4097-b60e-5713a78bbd54 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:07.306830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f2284-7fdf-4a5f-ab00-843a97c0684b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:07.307418 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f2284-7fdf-4a5f-ab00-843a97c0684b service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:07.307692 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f2284-7fdf-4a5f-ab00-843a97c0684b service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:07.307957 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f2284-7fdf-4a5f-ab00-843a97c0684b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:07.316827 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f2284-7fdf-4a5f-ab00-843a97c0684b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:07.318248 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f2284-7fdf-4a5f-ab00-843a97c0684b service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:07.328018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1430/2852] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:07.818539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961be53-413c-4164-810a-962170825d0a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:07.820029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6961be53-413c-4164-810a-962170825d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:07.832112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961be53-413c-4164-810a-962170825d0a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:07.835588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bd15d-29c9-4a5e-8cb5-062e893e4197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:07.836209 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bd15d-29c9-4a5e-8cb5-062e893e4197 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:07.836486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bd15d-29c9-4a5e-8cb5-062e893e4197 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:07.836756 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bd15d-29c9-4a5e-8cb5-062e893e4197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:07.893033 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bd15d-29c9-4a5e-8cb5-062e893e4197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:07.894449 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bd15d-29c9-4a5e-8cb5-062e893e4197 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:07.903091 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1423/2853] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:11.959863 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f2284-7fdf-4a5f-ab00-843a97c0684b service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:11.968592 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f2284-7fdf-4a5f-ab00-843a97c0684b service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:11.972388 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed0eb1-13ab-4a97-a531-03f9eb0baed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:11.972981 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0eb1-13ab-4a97-a531-03f9eb0baed7 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:11.973253 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0eb1-13ab-4a97-a531-03f9eb0baed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:11.973520 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0eb1-13ab-4a97-a531-03f9eb0baed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:12.030035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed0eb1-13ab-4a97-a531-03f9eb0baed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:12.031887 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed0eb1-13ab-4a97-a531-03f9eb0baed7 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:12.040521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1431/2854] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:14.085395 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bd15d-29c9-4a5e-8cb5-062e893e4197 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:14.151927 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bd15d-29c9-4a5e-8cb5-062e893e4197 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:14.156963 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:14.157576 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:14.157849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:14.158115 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] PATH_INFO: `/v3/users/906d945b7e2e4d22a23dc850c840f62a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:14.159231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=906d945b7e2e4d22a23dc850c840f62a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:14.161133 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:14.205919 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '906d945b7e2e4d22a23dc850c840f62a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.212208 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '906d945b7e2e4d22a23dc850c840f62a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.212857 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '906d945b7e2e4d22a23dc850c840f62a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.214741 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:14.229470 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '906d945b7e2e4d22a23dc850c840f62a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.237941 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '906d945b7e2e4d22a23dc850c840f62a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.243791 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1424/2855] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:14 2022] DELETE /identity/v3/users/906d945b7e2e4d22a23dc850c840f62a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:14.248442 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df7c5-af53-43a2-9dc3-aab6376f74a1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:14.248934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df7c5-af53-43a2-9dc3-aab6376f74a1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:14.249068 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df7c5-af53-43a2-9dc3-aab6376f74a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:14.268171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-212df7c5-af53-43a2-9dc3-aab6376f74a1 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:14.269363 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-212df7c5-af53-43a2-9dc3-aab6376f74a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:14.281932 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:14.329641 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1432/2856] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:14.339406 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:14.340801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:14.396891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689822d-74d0-454c-83ba-7afca3f7b494 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:14.400520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cd342-6ae6-4b58-a7d9-bedeb8a40af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:14.401109 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cd342-6ae6-4b58-a7d9-bedeb8a40af8 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:14.401388 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cd342-6ae6-4b58-a7d9-bedeb8a40af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:14.401653 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cd342-6ae6-4b58-a7d9-bedeb8a40af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:14.411158 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cd342-6ae6-4b58-a7d9-bedeb8a40af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:14.412568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cd342-6ae6-4b58-a7d9-bedeb8a40af8 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:14.422492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1425/2857] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:14.687429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df7c5-af53-43a2-9dc3-aab6376f74a1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:14.688868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-212df7c5-af53-43a2-9dc3-aab6376f74a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:14.703010 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df7c5-af53-43a2-9dc3-aab6376f74a1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:14.707853 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:14.708541 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:14.708822 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:14.709093 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] PATH_INFO: `/v3/projects/be2fdab357d645e49aebe13242f9a48f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:14.710308 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2fdab357d645e49aebe13242f9a48f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:14.712373 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:14.758950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2fdab357d645e49aebe13242f9a48f', 'request_id': 'req-dd1d46ce-5923-4e3d-a074-481f59a7aa13'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.766531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2fdab357d645e49aebe13242f9a48f', 'request_id': 'req-dd1d46ce-5923-4e3d-a074-481f59a7aa13'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.772220 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2fdab357d645e49aebe13242f9a48f', 'request_id': 'req-dd1d46ce-5923-4e3d-a074-481f59a7aa13'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.783843 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] The token cache is being invalidate because project be2fdab357d645e49aebe13242f9a48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:14.784151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.784791 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.786261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1433/2858] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:14 2022] DELETE /identity/v3/projects/be2fdab357d645e49aebe13242f9a48f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:14.790224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cd342-6ae6-4b58-a7d9-bedeb8a40af8 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:14.799673 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cd342-6ae6-4b58-a7d9-bedeb8a40af8 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:14.855073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:14.855618 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:14.855899 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:14.856172 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] PATH_INFO: `/v3/users/7c6f6586ad50417d8e3b0b31be5a7506` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:14.857288 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6f6586ad50417d8e3b0b31be5a7506)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:14.859286 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:14.904498 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6f6586ad50417d8e3b0b31be5a7506'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.912393 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6f6586ad50417d8e3b0b31be5a7506'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.913179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6f6586ad50417d8e3b0b31be5a7506'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.925145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6f6586ad50417d8e3b0b31be5a7506'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.930260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:14.932655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6f6586ad50417d8e3b0b31be5a7506'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:14.941370 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1426/2859] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:14 2022] DELETE /identity/v3/users/7c6f6586ad50417d8e3b0b31be5a7506 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:15.220890 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:15.222671 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:15.236244 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d46ce-5923-4e3d-a074-481f59a7aa13 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:15.301190 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:15.301899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:15.302086 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:15.302358 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] PATH_INFO: `/v3/projects/9151b7f8b98b43a7a155881ff68a293d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:15.303514 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9151b7f8b98b43a7a155881ff68a293d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:15.305424 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:15.348112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:15.351972 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9151b7f8b98b43a7a155881ff68a293d', 'request_id': 'req-564640ce-398c-48fc-9c4e-45efabf14475'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.359432 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9151b7f8b98b43a7a155881ff68a293d', 'request_id': 'req-564640ce-398c-48fc-9c4e-45efabf14475'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.365141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9151b7f8b98b43a7a155881ff68a293d', 'request_id': 'req-564640ce-398c-48fc-9c4e-45efabf14475'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.376621 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] The token cache is being invalidate because project 9151b7f8b98b43a7a155881ff68a293d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:15.376925 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.377570 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.381914 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1434/2860] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:15 2022] DELETE /identity/v3/projects/9151b7f8b98b43a7a155881ff68a293d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:15.383108 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:15.384527 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:15.397906 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd3d1e-0d5b-4ed2-957c-f9fa75a49baf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:15.456914 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:15.457543 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:15.457824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:15.458098 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] PATH_INFO: `/v3/users/eacc8c7b42614c3f99123559994f25ed` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:15.459260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eacc8c7b42614c3f99123559994f25ed)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:15.461182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:15.506171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eacc8c7b42614c3f99123559994f25ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.513852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eacc8c7b42614c3f99123559994f25ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.514478 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eacc8c7b42614c3f99123559994f25ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.526839 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eacc8c7b42614c3f99123559994f25ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.534249 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b163010c-61db-4df7-a5de-37854e17065e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eacc8c7b42614c3f99123559994f25ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.540073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1427/2861] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:15 2022] DELETE /identity/v3/users/eacc8c7b42614c3f99123559994f25ed => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:44:15.810802 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:15.813023 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:15.828129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564640ce-398c-48fc-9c4e-45efabf14475 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:15.885027 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:15.885661 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:15.885942 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:15.886218 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] PATH_INFO: `/v3/projects/c87438663212455fb47c5b62ae1add65` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:15.887411 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87438663212455fb47c5b62ae1add65)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:15.889378 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:15.935809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87438663212455fb47c5b62ae1add65', 'request_id': 'req-81634ead-2fcc-4722-869c-ffd0399f9ac9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.943545 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87438663212455fb47c5b62ae1add65', 'request_id': 'req-81634ead-2fcc-4722-869c-ffd0399f9ac9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.949421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87438663212455fb47c5b62ae1add65', 'request_id': 'req-81634ead-2fcc-4722-869c-ffd0399f9ac9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.961223 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] The token cache is being invalidate because project c87438663212455fb47c5b62ae1add65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:15.961509 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.962144 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-81634ead-2fcc-4722-869c-ffd0399f9ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:15.963650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1435/2862] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:15 2022] DELETE /identity/v3/projects/c87438663212455fb47c5b62ae1add65 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:15.969485 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cc853-c171-4c8f-8779-567cf487552d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:15.969773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cc853-c171-4c8f-8779-567cf487552d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:15.970048 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cc853-c171-4c8f-8779-567cf487552d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:15.989840 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-890cc853-c171-4c8f-8779-567cf487552d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:15.991078 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-890cc853-c171-4c8f-8779-567cf487552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:16.049760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1428/2863] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:16.058162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838d8bc-8524-4c5c-8377-cecff856da8d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.058445 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838d8bc-8524-4c5c-8377-cecff856da8d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.058742 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838d8bc-8524-4c5c-8377-cecff856da8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.079035 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2838d8bc-8524-4c5c-8377-cecff856da8d None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:16.080229 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2838d8bc-8524-4c5c-8377-cecff856da8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:16.088207 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1436/2864] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:16.092302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cc853-c171-4c8f-8779-567cf487552d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:16.102147 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cc853-c171-4c8f-8779-567cf487552d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:16.106669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb32485-7363-482e-bbf3-baf1062fbf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:16.107281 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb32485-7363-482e-bbf3-baf1062fbf72 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.107558 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb32485-7363-482e-bbf3-baf1062fbf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.107853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb32485-7363-482e-bbf3-baf1062fbf72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.108984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb32485-7363-482e-bbf3-baf1062fbf72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:44:16.109785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb32485-7363-482e-bbf3-baf1062fbf72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:16.111407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb32485-7363-482e-bbf3-baf1062fbf72 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:16.123015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1429/2865] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:44:16.128242 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838d8bc-8524-4c5c-8377-cecff856da8d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:16.137817 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838d8bc-8524-4c5c-8377-cecff856da8d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:16.142700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bc7a6-547d-4064-ba25-7617be1ceae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:16.143304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc7a6-547d-4064-ba25-7617be1ceae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.143589 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc7a6-547d-4064-ba25-7617be1ceae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.143870 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc7a6-547d-4064-ba25-7617be1ceae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.144482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bc7a6-547d-4064-ba25-7617be1ceae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:16.146387 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bc7a6-547d-4064-ba25-7617be1ceae5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:16.183013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1437/2866] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:16 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:16.188016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb32485-7363-482e-bbf3-baf1062fbf72 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:16.193182 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:16.199716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb32485-7363-482e-bbf3-baf1062fbf72 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:16.257301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e8e5-8b4a-4802-973f-0ef37e236290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:16.258292 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e8e5-8b4a-4802-973f-0ef37e236290 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.258824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e8e5-8b4a-4802-973f-0ef37e236290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.259319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e8e5-8b4a-4802-973f-0ef37e236290 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.260494 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6e8e5-8b4a-4802-973f-0ef37e236290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:16.264217 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6e8e5-8b4a-4802-973f-0ef37e236290 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:16.292125 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1430/2867] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:16 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:44:16.296872 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bc7a6-547d-4064-ba25-7617be1ceae5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:16.307255 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bc7a6-547d-4064-ba25-7617be1ceae5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:16.312478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b814aab-f415-4bc1-b88d-6e6d47aa3447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:16.313251 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b814aab-f415-4bc1-b88d-6e6d47aa3447 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.313535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b814aab-f415-4bc1-b88d-6e6d47aa3447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.313841 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b814aab-f415-4bc1-b88d-6e6d47aa3447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.314505 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b814aab-f415-4bc1-b88d-6e6d47aa3447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:16.316216 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b814aab-f415-4bc1-b88d-6e6d47aa3447 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:16.326486 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1438/2868] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:16.330922 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e8e5-8b4a-4802-973f-0ef37e236290 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:16.340665 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e8e5-8b4a-4802-973f-0ef37e236290 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:16.346169 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fdf7a-e7f6-4c1e-b273-d2b6d2187363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:16.346794 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fdf7a-e7f6-4c1e-b273-d2b6d2187363 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.347073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fdf7a-e7f6-4c1e-b273-d2b6d2187363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.347341 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fdf7a-e7f6-4c1e-b273-d2b6d2187363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.347974 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fdf7a-e7f6-4c1e-b273-d2b6d2187363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:16.349552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fdf7a-e7f6-4c1e-b273-d2b6d2187363 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:16.360686 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1431/2869] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:16.364705 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b814aab-f415-4bc1-b88d-6e6d47aa3447 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:16.374901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b814aab-f415-4bc1-b88d-6e6d47aa3447 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:16.379534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359b6b9-a155-4ca0-8044-61c7b1f366c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:16.380171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359b6b9-a155-4ca0-8044-61c7b1f366c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.380446 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359b6b9-a155-4ca0-8044-61c7b1f366c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.380714 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359b6b9-a155-4ca0-8044-61c7b1f366c8 admin admin] PATH_INFO: `/v3/projects/e1a3688c1cdd456fb8da424eeff6dbdc/users/f4d691ccd448451b9022d86d27b86548/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.391770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:16.395967 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359b6b9-a155-4ca0-8044-61c7b1f366c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a3688c1cdd456fb8da424eeff6dbdc, user_id=f4d691ccd448451b9022d86d27b86548, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:16.399267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359b6b9-a155-4ca0-8044-61c7b1f366c8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:16.412593 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1439/2870] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:16 2022] PUT /identity/v3/projects/e1a3688c1cdd456fb8da424eeff6dbdc/users/f4d691ccd448451b9022d86d27b86548/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:16.424010 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1ac3-6f6c-4f6f-92ed-ea514a4f6b44 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.424512 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1ac3-6f6c-4f6f-92ed-ea514a4f6b44 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.424628 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1ac3-6f6c-4f6f-92ed-ea514a4f6b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.452837 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2d4f1ac3-6f6c-4f6f-92ed-ea514a4f6b44 None None] MFA Rules not processed for user `f4d691ccd448451b9022d86d27b86548`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:16.453967 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2d4f1ac3-6f6c-4f6f-92ed-ea514a4f6b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:16.516729 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1432/2871] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:16.527864 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359b6b9-a155-4ca0-8044-61c7b1f366c8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:16.529535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a359b6b9-a155-4ca0-8044-61c7b1f366c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:16.586203 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359b6b9-a155-4ca0-8044-61c7b1f366c8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:16.589858 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8893748-467a-44fd-83f1-b7c67804af54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:16.590452 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8893748-467a-44fd-83f1-b7c67804af54 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.590761 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8893748-467a-44fd-83f1-b7c67804af54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.591034 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8893748-467a-44fd-83f1-b7c67804af54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.600011 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8893748-467a-44fd-83f1-b7c67804af54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:16.601467 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8893748-467a-44fd-83f1-b7c67804af54 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:16.611061 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1440/2872] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:16.632319 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1ac3-6f6c-4f6f-92ed-ea514a4f6b44 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:16.693035 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1ac3-6f6c-4f6f-92ed-ea514a4f6b44 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:16.697666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:16.698302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.698584 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.698892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] PATH_INFO: `/v3/users/f4d691ccd448451b9022d86d27b86548` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.700039 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d691ccd448451b9022d86d27b86548)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:16.701954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:16.715027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:16.748542 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d691ccd448451b9022d86d27b86548'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:16.755864 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d691ccd448451b9022d86d27b86548'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:16.756493 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d691ccd448451b9022d86d27b86548'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:16.768801 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d691ccd448451b9022d86d27b86548'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:16.775509 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d691ccd448451b9022d86d27b86548'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:16.781997 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1433/2873] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:16 2022] DELETE /identity/v3/users/f4d691ccd448451b9022d86d27b86548 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:16.786403 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b53f4-5267-4eb6-971f-ec7ac538afbf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.786703 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b53f4-5267-4eb6-971f-ec7ac538afbf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.786983 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b53f4-5267-4eb6-971f-ec7ac538afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.806151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-354b53f4-5267-4eb6-971f-ec7ac538afbf None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:16.807357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-354b53f4-5267-4eb6-971f-ec7ac538afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:16.865354 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1441/2874] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:16.875884 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:16.877298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:16.934066 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48748e11-97e8-4bd1-9a12-9a1b701aa414 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:16.937725 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c33a2a-c24f-41e8-ab19-e44dc230a08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:16.938314 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c33a2a-c24f-41e8-ab19-e44dc230a08e service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:16.938593 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c33a2a-c24f-41e8-ab19-e44dc230a08e service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:16.938891 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c33a2a-c24f-41e8-ab19-e44dc230a08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:16.947696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c33a2a-c24f-41e8-ab19-e44dc230a08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:16.949101 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c33a2a-c24f-41e8-ab19-e44dc230a08e service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:16.958982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1434/2875] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:44:17.224267 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b53f4-5267-4eb6-971f-ec7ac538afbf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:17.225844 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-354b53f4-5267-4eb6-971f-ec7ac538afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:17.239328 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b53f4-5267-4eb6-971f-ec7ac538afbf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:17.243966 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:17.245338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.245628 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.246025 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] PATH_INFO: `/v3/projects/e1a3688c1cdd456fb8da424eeff6dbdc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.247215 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a3688c1cdd456fb8da424eeff6dbdc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:17.250026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:17.297902 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a3688c1cdd456fb8da424eeff6dbdc', 'request_id': 'req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:17.305342 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a3688c1cdd456fb8da424eeff6dbdc', 'request_id': 'req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:17.311431 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a3688c1cdd456fb8da424eeff6dbdc', 'request_id': 'req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:17.323276 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] The token cache is being invalidate because project e1a3688c1cdd456fb8da424eeff6dbdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:17.323563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:17.324197 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9563b8c-7c9e-4316-8a71-df3f6b9fa631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:17.325699 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1442/2876] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:17 2022] DELETE /identity/v3/projects/e1a3688c1cdd456fb8da424eeff6dbdc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:17.331666 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf5ffe-aa66-48df-a9cd-54a95863eaeb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.331955 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf5ffe-aa66-48df-a9cd-54a95863eaeb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.332231 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf5ffe-aa66-48df-a9cd-54a95863eaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.351571 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8eaf5ffe-aa66-48df-a9cd-54a95863eaeb None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:17.352761 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8eaf5ffe-aa66-48df-a9cd-54a95863eaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:17.410586 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1435/2877] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:17.419476 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b87fd-5ed3-4f4e-a67d-8b3e27a39ded None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.419830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b87fd-5ed3-4f4e-a67d-8b3e27a39ded None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.420131 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b87fd-5ed3-4f4e-a67d-8b3e27a39ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.440155 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3a9b87fd-5ed3-4f4e-a67d-8b3e27a39ded None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:17.441336 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a9b87fd-5ed3-4f4e-a67d-8b3e27a39ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:17.449141 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1443/2878] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:17.453984 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf5ffe-aa66-48df-a9cd-54a95863eaeb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:17.463551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf5ffe-aa66-48df-a9cd-54a95863eaeb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:17.468085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff72ffd-3542-4718-93d6-9f2938f95402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:17.468679 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72ffd-3542-4718-93d6-9f2938f95402 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.468951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72ffd-3542-4718-93d6-9f2938f95402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.469219 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72ffd-3542-4718-93d6-9f2938f95402 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.469853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff72ffd-3542-4718-93d6-9f2938f95402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:44:17.470148 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff72ffd-3542-4718-93d6-9f2938f95402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:17.471799 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff72ffd-3542-4718-93d6-9f2938f95402 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:17.483004 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1436/2879] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:44:17.487785 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b87fd-5ed3-4f4e-a67d-8b3e27a39ded None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:17.496697 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b87fd-5ed3-4f4e-a67d-8b3e27a39ded None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:17.502338 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976e4f7-a020-4157-b441-fa18a2d25490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:17.502949 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e4f7-a020-4157-b441-fa18a2d25490 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.503225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e4f7-a020-4157-b441-fa18a2d25490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.503497 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e4f7-a020-4157-b441-fa18a2d25490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.504129 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976e4f7-a020-4157-b441-fa18a2d25490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:17.506018 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976e4f7-a020-4157-b441-fa18a2d25490 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:17.511292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:17.533261 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1444/2880] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:17 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:17.537396 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff72ffd-3542-4718-93d6-9f2938f95402 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:17.547868 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff72ffd-3542-4718-93d6-9f2938f95402 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:17.565056 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:17.604256 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce84d0-329c-40d2-be8d-629fbdb3b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:17.604849 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce84d0-329c-40d2-be8d-629fbdb3b7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.605127 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce84d0-329c-40d2-be8d-629fbdb3b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.605399 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce84d0-329c-40d2-be8d-629fbdb3b7f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.606015 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce84d0-329c-40d2-be8d-629fbdb3b7f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:17.607954 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce84d0-329c-40d2-be8d-629fbdb3b7f6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:17.630810 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1437/2881] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:17 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:17.634876 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976e4f7-a020-4157-b441-fa18a2d25490 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:17.645243 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976e4f7-a020-4157-b441-fa18a2d25490 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:17.649810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056d45-90ef-4b72-ac85-865e11eb7d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:17.650396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056d45-90ef-4b72-ac85-865e11eb7d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.650673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056d45-90ef-4b72-ac85-865e11eb7d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.650973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056d45-90ef-4b72-ac85-865e11eb7d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.651610 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33056d45-90ef-4b72-ac85-865e11eb7d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:17.653194 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33056d45-90ef-4b72-ac85-865e11eb7d33 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:17.662838 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1445/2882] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:17.666539 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce84d0-329c-40d2-be8d-629fbdb3b7f6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:17.677187 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce84d0-329c-40d2-be8d-629fbdb3b7f6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:17.681961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bb171-c532-49cc-88af-d5494ba8babd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:17.682611 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bb171-c532-49cc-88af-d5494ba8babd admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.682828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bb171-c532-49cc-88af-d5494ba8babd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.683145 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bb171-c532-49cc-88af-d5494ba8babd admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.683717 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bb171-c532-49cc-88af-d5494ba8babd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:17.685353 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bb171-c532-49cc-88af-d5494ba8babd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:17.696859 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1438/2883] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:17.701259 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056d45-90ef-4b72-ac85-865e11eb7d33 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:17.711420 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056d45-90ef-4b72-ac85-865e11eb7d33 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:17.715934 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e583-8ba1-42c6-82ac-fcf8b73c1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:17.716598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e583-8ba1-42c6-82ac-fcf8b73c1ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.716874 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e583-8ba1-42c6-82ac-fcf8b73c1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.717143 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e583-8ba1-42c6-82ac-fcf8b73c1ea0 admin admin] PATH_INFO: `/v3/projects/797e0a007d584cbe857b6b013138d24b/users/f1d217840fbe4648ab1a99a90fe4ed5c/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.731534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e583-8ba1-42c6-82ac-fcf8b73c1ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=797e0a007d584cbe857b6b013138d24b, user_id=f1d217840fbe4648ab1a99a90fe4ed5c, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:17.734793 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e583-8ba1-42c6-82ac-fcf8b73c1ea0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:17.747419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1446/2884] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:17 2022] PUT /identity/v3/projects/797e0a007d584cbe857b6b013138d24b/users/f1d217840fbe4648ab1a99a90fe4ed5c/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:17.758544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde35e-9c1b-413d-ba80-6d5f329fbbd9 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.758879 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde35e-9c1b-413d-ba80-6d5f329fbbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.759155 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde35e-9c1b-413d-ba80-6d5f329fbbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.786366 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6dbde35e-9c1b-413d-ba80-6d5f329fbbd9 None None] MFA Rules not processed for user `f1d217840fbe4648ab1a99a90fe4ed5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:17.787674 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6dbde35e-9c1b-413d-ba80-6d5f329fbbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:17.850669 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1439/2885] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:17.855233 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e583-8ba1-42c6-82ac-fcf8b73c1ea0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:17.915234 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e583-8ba1-42c6-82ac-fcf8b73c1ea0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:17.919866 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7e86-7ed7-47af-923d-d3a0843e7329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:17.920462 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7e86-7ed7-47af-923d-d3a0843e7329 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:17.920739 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7e86-7ed7-47af-923d-d3a0843e7329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:17.921041 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7e86-7ed7-47af-923d-d3a0843e7329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:17.922172 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7e86-7ed7-47af-923d-d3a0843e7329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:17.924123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7e86-7ed7-47af-923d-d3a0843e7329 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:17.951374 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1447/2886] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:17 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:44:17.955665 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde35e-9c1b-413d-ba80-6d5f329fbbd9 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:17.966239 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde35e-9c1b-413d-ba80-6d5f329fbbd9 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.020690 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb92c7-5091-4ba8-aecc-78d64092aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.021329 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb92c7-5091-4ba8-aecc-78d64092aa46 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.021557 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb92c7-5091-4ba8-aecc-78d64092aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.021828 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb92c7-5091-4ba8-aecc-78d64092aa46 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.022452 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb92c7-5091-4ba8-aecc-78d64092aa46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.024410 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb92c7-5091-4ba8-aecc-78d64092aa46 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.045503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1440/2887] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:17 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:44:18.049980 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7e86-7ed7-47af-923d-d3a0843e7329 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.060123 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7e86-7ed7-47af-923d-d3a0843e7329 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.065060 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe91b8-61c1-4aaf-b805-28611a5faf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.065651 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe91b8-61c1-4aaf-b805-28611a5faf65 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.065922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe91b8-61c1-4aaf-b805-28611a5faf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.066188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe91b8-61c1-4aaf-b805-28611a5faf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.066880 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe91b8-61c1-4aaf-b805-28611a5faf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.068461 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe91b8-61c1-4aaf-b805-28611a5faf65 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.079868 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1448/2888] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:18.083785 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb92c7-5091-4ba8-aecc-78d64092aa46 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.094364 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb92c7-5091-4ba8-aecc-78d64092aa46 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.099032 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedf617-b41b-44ac-8873-c19f14208c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.099624 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedf617-b41b-44ac-8873-c19f14208c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.099902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedf617-b41b-44ac-8873-c19f14208c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.100174 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedf617-b41b-44ac-8873-c19f14208c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.100811 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedf617-b41b-44ac-8873-c19f14208c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.102396 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedf617-b41b-44ac-8873-c19f14208c6a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.112790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1441/2889] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:18.116950 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe91b8-61c1-4aaf-b805-28611a5faf65 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.127394 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe91b8-61c1-4aaf-b805-28611a5faf65 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.132487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20d445-6bbb-400d-87e4-c4a7071f21f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.133134 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20d445-6bbb-400d-87e4-c4a7071f21f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.133407 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20d445-6bbb-400d-87e4-c4a7071f21f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.133672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20d445-6bbb-400d-87e4-c4a7071f21f5 admin admin] PATH_INFO: `/v3/projects/1b7006a4082a496c90667728ddbae3b0/users/1fae4209441a409199c7cd1cbfffa9f1/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.148100 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20d445-6bbb-400d-87e4-c4a7071f21f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7006a4082a496c90667728ddbae3b0, user_id=1fae4209441a409199c7cd1cbfffa9f1, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.150772 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20d445-6bbb-400d-87e4-c4a7071f21f5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.163763 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1449/2890] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:18 2022] PUT /identity/v3/projects/1b7006a4082a496c90667728ddbae3b0/users/1fae4209441a409199c7cd1cbfffa9f1/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:18.174436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2315e7-f1b4-4b38-9d19-0b4dd9659d18 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.174759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2315e7-f1b4-4b38-9d19-0b4dd9659d18 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.175034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2315e7-f1b4-4b38-9d19-0b4dd9659d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.190325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:18.204951 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-be2315e7-f1b4-4b38-9d19-0b4dd9659d18 None None] MFA Rules not processed for user `1fae4209441a409199c7cd1cbfffa9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:18.206149 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-be2315e7-f1b4-4b38-9d19-0b4dd9659d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:18.269064 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1442/2891] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:18.274286 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20d445-6bbb-400d-87e4-c4a7071f21f5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.336919 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20d445-6bbb-400d-87e4-c4a7071f21f5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.341598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85897c8-f476-41c9-9770-2597ea85e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.342199 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85897c8-f476-41c9-9770-2597ea85e7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.342478 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85897c8-f476-41c9-9770-2597ea85e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.342782 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85897c8-f476-41c9-9770-2597ea85e7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.343964 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85897c8-f476-41c9-9770-2597ea85e7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.345999 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85897c8-f476-41c9-9770-2597ea85e7e9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.351551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:18.378252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1450/2892] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:18 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:18.379712 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2315e7-f1b4-4b38-9d19-0b4dd9659d18 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.391095 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2315e7-f1b4-4b38-9d19-0b4dd9659d18 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.447224 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ad178-c02f-4eb4-a5db-4378290a1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.447833 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ad178-c02f-4eb4-a5db-4378290a1614 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.448112 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ad178-c02f-4eb4-a5db-4378290a1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.448382 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ad178-c02f-4eb4-a5db-4378290a1614 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.449012 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ad178-c02f-4eb4-a5db-4378290a1614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.450966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ad178-c02f-4eb4-a5db-4378290a1614 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.473559 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1443/2893] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:18 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:18.477656 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85897c8-f476-41c9-9770-2597ea85e7e9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.489014 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85897c8-f476-41c9-9770-2597ea85e7e9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.493576 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01575-a357-4742-932f-841ed4894247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.494174 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01575-a357-4742-932f-841ed4894247 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.494455 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01575-a357-4742-932f-841ed4894247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.494758 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01575-a357-4742-932f-841ed4894247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.495396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c01575-a357-4742-932f-841ed4894247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.496986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c01575-a357-4742-932f-841ed4894247 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.507044 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1451/2894] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:44:18.511237 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ad178-c02f-4eb4-a5db-4378290a1614 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.521950 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ad178-c02f-4eb4-a5db-4378290a1614 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.527093 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25e616-6cb3-47d7-9db3-e0cce20bd5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.527682 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25e616-6cb3-47d7-9db3-e0cce20bd5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.527958 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25e616-6cb3-47d7-9db3-e0cce20bd5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.528229 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25e616-6cb3-47d7-9db3-e0cce20bd5f6 admin admin] PATH_INFO: `/v3/projects/86b733c5d33b4ab994824423d7000b11/users/7082ee18768044859ac1f217d1cb7b59/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.543450 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25e616-6cb3-47d7-9db3-e0cce20bd5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b733c5d33b4ab994824423d7000b11, user_id=7082ee18768044859ac1f217d1cb7b59, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.546296 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25e616-6cb3-47d7-9db3-e0cce20bd5f6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.558461 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1444/2895] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:18 2022] PUT /identity/v3/projects/86b733c5d33b4ab994824423d7000b11/users/7082ee18768044859ac1f217d1cb7b59/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:18.562991 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01575-a357-4742-932f-841ed4894247 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.572717 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01575-a357-4742-932f-841ed4894247 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.628315 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c383a5-a00c-495c-b7fb-b5ea94924b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.628922 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c383a5-a00c-495c-b7fb-b5ea94924b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.629200 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c383a5-a00c-495c-b7fb-b5ea94924b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.629472 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c383a5-a00c-495c-b7fb-b5ea94924b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.630114 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c383a5-a00c-495c-b7fb-b5ea94924b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.631745 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c383a5-a00c-495c-b7fb-b5ea94924b5a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.641882 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1452/2896] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:18.646052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25e616-6cb3-47d7-9db3-e0cce20bd5f6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.656369 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25e616-6cb3-47d7-9db3-e0cce20bd5f6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.660892 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c7986-1045-4533-8d0c-e16715aeef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.661523 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c7986-1045-4533-8d0c-e16715aeef51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.661800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c7986-1045-4533-8d0c-e16715aeef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.662068 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c7986-1045-4533-8d0c-e16715aeef51 admin admin] PATH_INFO: `/v3/projects/86b733c5d33b4ab994824423d7000b11/users/7082ee18768044859ac1f217d1cb7b59/roles/946af2ff291349299db56e09aacb6b03` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.664009 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c7986-1045-4533-8d0c-e16715aeef51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b733c5d33b4ab994824423d7000b11, user_id=7082ee18768044859ac1f217d1cb7b59, role_id=946af2ff291349299db56e09aacb6b03)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.666621 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c7986-1045-4533-8d0c-e16715aeef51 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.676855 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1445/2897] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:18 2022] PUT /identity/v3/projects/86b733c5d33b4ab994824423d7000b11/users/7082ee18768044859ac1f217d1cb7b59/roles/946af2ff291349299db56e09aacb6b03 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:18.688575 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e5c22-ce1a-4e34-a10d-27b22425f9e7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.688865 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e5c22-ce1a-4e34-a10d-27b22425f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.689142 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e5c22-ce1a-4e34-a10d-27b22425f9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.717252 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-032e5c22-ce1a-4e34-a10d-27b22425f9e7 None None] MFA Rules not processed for user `7082ee18768044859ac1f217d1cb7b59`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:18.718562 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-032e5c22-ce1a-4e34-a10d-27b22425f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:18.786262 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1453/2898] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:18.797626 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c7986-1045-4533-8d0c-e16715aeef51 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:18.799407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c89c7986-1045-4533-8d0c-e16715aeef51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:18.852591 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:18.857050 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c7986-1045-4533-8d0c-e16715aeef51 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:18.861595 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d547c-7553-4bde-84bb-b967a9cfa70f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:18.862196 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d547c-7553-4bde-84bb-b967a9cfa70f service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:18.862473 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d547c-7553-4bde-84bb-b967a9cfa70f service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:18.862779 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d547c-7553-4bde-84bb-b967a9cfa70f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:18.917796 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d547c-7553-4bde-84bb-b967a9cfa70f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:18.919283 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d547c-7553-4bde-84bb-b967a9cfa70f service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:18.928266 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1446/2899] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:20.434797 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e5c22-ce1a-4e34-a10d-27b22425f9e7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:20.436213 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-032e5c22-ce1a-4e34-a10d-27b22425f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:20.448306 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e5c22-ce1a-4e34-a10d-27b22425f9e7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:20.451881 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8efdb-02be-4482-b43b-3170f618113b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:20.453162 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8efdb-02be-4482-b43b-3170f618113b service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:20.453443 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8efdb-02be-4482-b43b-3170f618113b service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:20.453720 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8efdb-02be-4482-b43b-3170f618113b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:20.506531 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:20.508938 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8efdb-02be-4482-b43b-3170f618113b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:20.510700 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8efdb-02be-4482-b43b-3170f618113b service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:20.520998 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1454/2900] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:21.025405 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d547c-7553-4bde-84bb-b967a9cfa70f service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:21.034034 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d547c-7553-4bde-84bb-b967a9cfa70f service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:21.037612 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c77cb-0054-4e84-a090-5eecc093b52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:21.038200 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c77cb-0054-4e84-a090-5eecc093b52b service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:21.038479 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c77cb-0054-4e84-a090-5eecc093b52b service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:21.038787 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c77cb-0054-4e84-a090-5eecc093b52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:21.047860 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c77cb-0054-4e84-a090-5eecc093b52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:21.049263 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c77cb-0054-4e84-a090-5eecc093b52b service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:21.058522 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1447/2901] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:24.900204 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8efdb-02be-4482-b43b-3170f618113b service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:24.962088 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8efdb-02be-4482-b43b-3170f618113b service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:24.966534 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:24.967188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:24.967468 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:24.968344 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] PATH_INFO: `/v3/users/f1d217840fbe4648ab1a99a90fe4ed5c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:24.969437 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d217840fbe4648ab1a99a90fe4ed5c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:24.971421 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:25.017051 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d217840fbe4648ab1a99a90fe4ed5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.028685 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d217840fbe4648ab1a99a90fe4ed5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.036030 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d217840fbe4648ab1a99a90fe4ed5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.043396 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d217840fbe4648ab1a99a90fe4ed5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.044099 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d217840fbe4648ab1a99a90fe4ed5c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.050382 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1455/2902] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:24 2022] DELETE /identity/v3/users/f1d217840fbe4648ab1a99a90fe4ed5c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:25.054947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441c00-71b8-41f5-9ea8-719e4504ebf2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:25.055431 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441c00-71b8-41f5-9ea8-719e4504ebf2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:25.055551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441c00-71b8-41f5-9ea8-719e4504ebf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:25.074325 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-32441c00-71b8-41f5-9ea8-719e4504ebf2 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:25.075556 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-32441c00-71b8-41f5-9ea8-719e4504ebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:25.135013 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1448/2903] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:25.145205 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:25.146645 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:25.203312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118466-0d7a-4826-a64d-439fb304fd79 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:25.207026 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81d30-2591-4045-9485-f0f0c5f66f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:25.207626 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81d30-2591-4045-9485-f0f0c5f66f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:25.207908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81d30-2591-4045-9485-f0f0c5f66f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:25.208186 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81d30-2591-4045-9485-f0f0c5f66f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:25.217067 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d81d30-2591-4045-9485-f0f0c5f66f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:25.219019 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d81d30-2591-4045-9485-f0f0c5f66f75 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:25.228292 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1456/2904] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:25.494633 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441c00-71b8-41f5-9ea8-719e4504ebf2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:25.496171 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-32441c00-71b8-41f5-9ea8-719e4504ebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:25.513486 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441c00-71b8-41f5-9ea8-719e4504ebf2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:25.519547 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:25.520090 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:25.520392 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:25.520599 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] PATH_INFO: `/v3/projects/797e0a007d584cbe857b6b013138d24b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:25.521759 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=797e0a007d584cbe857b6b013138d24b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:25.523947 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:25.569568 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797e0a007d584cbe857b6b013138d24b', 'request_id': 'req-936b1c1d-1be3-482c-91c7-9658988ea0e9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.575588 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797e0a007d584cbe857b6b013138d24b', 'request_id': 'req-936b1c1d-1be3-482c-91c7-9658988ea0e9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.581252 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797e0a007d584cbe857b6b013138d24b', 'request_id': 'req-936b1c1d-1be3-482c-91c7-9658988ea0e9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.594105 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] The token cache is being invalidate because project 797e0a007d584cbe857b6b013138d24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:25.594390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.595029 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.596533 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1449/2905] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:25 2022] DELETE /identity/v3/projects/797e0a007d584cbe857b6b013138d24b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:25.600659 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81d30-2591-4045-9485-f0f0c5f66f75 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:25.611013 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81d30-2591-4045-9485-f0f0c5f66f75 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:25.623419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:25.670917 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:25.671708 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:25.671901 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:25.672177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] PATH_INFO: `/v3/users/1fae4209441a409199c7cd1cbfffa9f1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:25.673325 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fae4209441a409199c7cd1cbfffa9f1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:25.675343 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:25.724324 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fae4209441a409199c7cd1cbfffa9f1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.736810 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fae4209441a409199c7cd1cbfffa9f1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.743608 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fae4209441a409199c7cd1cbfffa9f1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.751475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fae4209441a409199c7cd1cbfffa9f1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.752087 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fae4209441a409199c7cd1cbfffa9f1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:25.758069 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1457/2906] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:25 2022] DELETE /identity/v3/users/1fae4209441a409199c7cd1cbfffa9f1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:44:26.022213 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:26.023915 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:26.037374 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1c1d-1be3-482c-91c7-9658988ea0e9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:26.047030 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:26.095957 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:26.096601 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:26.096841 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:26.097107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] PATH_INFO: `/v3/projects/1b7006a4082a496c90667728ddbae3b0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:26.098308 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7006a4082a496c90667728ddbae3b0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:26.100289 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:26.146230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7006a4082a496c90667728ddbae3b0', 'request_id': 'req-708014f1-9b69-48c2-bd2e-29281ed48e4d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.152193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7006a4082a496c90667728ddbae3b0', 'request_id': 'req-708014f1-9b69-48c2-bd2e-29281ed48e4d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.158179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7006a4082a496c90667728ddbae3b0', 'request_id': 'req-708014f1-9b69-48c2-bd2e-29281ed48e4d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.170153 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] The token cache is being invalidate because project 1b7006a4082a496c90667728ddbae3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:26.170436 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.171770 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.173230 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1450/2907] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:26 2022] DELETE /identity/v3/projects/1b7006a4082a496c90667728ddbae3b0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:26.177365 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:26.178867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:26.191535 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b810a8-2407-411c-a4a2-4e4c62bd7e62 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:26.248697 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:26.249447 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:26.249728 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:26.250004 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] PATH_INFO: `/v3/users/7082ee18768044859ac1f217d1cb7b59` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:26.251151 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7082ee18768044859ac1f217d1cb7b59)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:26.253072 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:26.298655 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:26.306241 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7082ee18768044859ac1f217d1cb7b59'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.318405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7082ee18768044859ac1f217d1cb7b59'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.325209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7082ee18768044859ac1f217d1cb7b59'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.332830 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7082ee18768044859ac1f217d1cb7b59'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.333493 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d90c443f-fce5-4a25-af49-df66507472f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7082ee18768044859ac1f217d1cb7b59'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.339361 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1458/2908] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:26 2022] DELETE /identity/v3/users/7082ee18768044859ac1f217d1cb7b59 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:26.610550 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:26.612008 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:26.626710 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708014f1-9b69-48c2-bd2e-29281ed48e4d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:26.683946 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:26.684575 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:26.684853 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:26.685129 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] PATH_INFO: `/v3/projects/86b733c5d33b4ab994824423d7000b11` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:26.686356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b733c5d33b4ab994824423d7000b11)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:26.688644 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:26.732298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:26.735586 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b733c5d33b4ab994824423d7000b11', 'request_id': 'req-9689d12c-e059-4dc6-b052-697f9d248c42'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.742552 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b733c5d33b4ab994824423d7000b11', 'request_id': 'req-9689d12c-e059-4dc6-b052-697f9d248c42'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.748260 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b733c5d33b4ab994824423d7000b11', 'request_id': 'req-9689d12c-e059-4dc6-b052-697f9d248c42'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.760373 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] The token cache is being invalidate because project 86b733c5d33b4ab994824423d7000b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:26.760656 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.761276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9689d12c-e059-4dc6-b052-697f9d248c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:26.762764 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1451/2909] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:26 2022] DELETE /identity/v3/projects/86b733c5d33b4ab994824423d7000b11 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:26.768219 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109e444-991d-445b-9fe9-f43f800a6d34 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:26.768504 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109e444-991d-445b-9fe9-f43f800a6d34 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:26.768778 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109e444-991d-445b-9fe9-f43f800a6d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:26.788598 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0109e444-991d-445b-9fe9-f43f800a6d34 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:26.789788 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0109e444-991d-445b-9fe9-f43f800a6d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:26.847867 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1459/2910] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:26.855513 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f39bc6-78e9-432c-a779-85c127d66432 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:26.855803 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f39bc6-78e9-432c-a779-85c127d66432 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:26.856080 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f39bc6-78e9-432c-a779-85c127d66432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:26.876085 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c2f39bc6-78e9-432c-a779-85c127d66432 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:26.877276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c2f39bc6-78e9-432c-a779-85c127d66432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:26.885387 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1452/2911] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:26.890171 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109e444-991d-445b-9fe9-f43f800a6d34 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:26.900042 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109e444-991d-445b-9fe9-f43f800a6d34 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:26.904612 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7f77-7c90-4df5-9d70-2e5d5a693814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:26.905238 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7f77-7c90-4df5-9d70-2e5d5a693814 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:26.905516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7f77-7c90-4df5-9d70-2e5d5a693814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:26.905786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7f77-7c90-4df5-9d70-2e5d5a693814 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:26.906429 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7f77-7c90-4df5-9d70-2e5d5a693814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:44:26.906764 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7f77-7c90-4df5-9d70-2e5d5a693814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:26.908400 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7f77-7c90-4df5-9d70-2e5d5a693814 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:26.919652 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1460/2912] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:44:26.924027 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f39bc6-78e9-432c-a779-85c127d66432 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:26.933235 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f39bc6-78e9-432c-a779-85c127d66432 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:26.938815 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92fa6-e805-4a97-9bd8-58977aabd6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:26.939409 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92fa6-e805-4a97-9bd8-58977aabd6eb admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:26.939689 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92fa6-e805-4a97-9bd8-58977aabd6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:26.939960 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92fa6-e805-4a97-9bd8-58977aabd6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:26.940596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc92fa6-e805-4a97-9bd8-58977aabd6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:26.942469 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc92fa6-e805-4a97-9bd8-58977aabd6eb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:26.969574 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1453/2913] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:26 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:26.973672 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7f77-7c90-4df5-9d70-2e5d5a693814 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:26.983687 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7f77-7c90-4df5-9d70-2e5d5a693814 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:27.039644 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a67220-8fbb-484f-bfc3-c9e2bf860417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:27.040275 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a67220-8fbb-484f-bfc3-c9e2bf860417 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:27.040554 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a67220-8fbb-484f-bfc3-c9e2bf860417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:27.040825 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a67220-8fbb-484f-bfc3-c9e2bf860417 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:27.041464 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a67220-8fbb-484f-bfc3-c9e2bf860417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:27.043474 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a67220-8fbb-484f-bfc3-c9e2bf860417 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:27.064771 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1461/2914] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:26 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:27.068938 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92fa6-e805-4a97-9bd8-58977aabd6eb admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:27.079667 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92fa6-e805-4a97-9bd8-58977aabd6eb admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:27.084304 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0667d9-840d-4c9c-bd5d-bd315840802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:27.084902 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0667d9-840d-4c9c-bd5d-bd315840802f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:27.085179 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0667d9-840d-4c9c-bd5d-bd315840802f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:27.085456 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0667d9-840d-4c9c-bd5d-bd315840802f admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:27.086130 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0667d9-840d-4c9c-bd5d-bd315840802f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:27.087760 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0667d9-840d-4c9c-bd5d-bd315840802f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:27.097655 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1454/2915] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:27.101551 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a67220-8fbb-484f-bfc3-c9e2bf860417 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:27.111600 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a67220-8fbb-484f-bfc3-c9e2bf860417 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:27.116225 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d6f35-e82f-496e-b48f-657318b7fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:27.116816 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d6f35-e82f-496e-b48f-657318b7fe8c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:27.117092 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d6f35-e82f-496e-b48f-657318b7fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:27.117364 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d6f35-e82f-496e-b48f-657318b7fe8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:27.118003 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d6f35-e82f-496e-b48f-657318b7fe8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:27.119632 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d6f35-e82f-496e-b48f-657318b7fe8c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:27.130845 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1462/2916] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:27.135300 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0667d9-840d-4c9c-bd5d-bd315840802f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:27.146089 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0667d9-840d-4c9c-bd5d-bd315840802f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:27.150877 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447c275-f4a7-42e7-8402-eb63473ab84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:27.151521 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447c275-f4a7-42e7-8402-eb63473ab84a admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:27.151800 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447c275-f4a7-42e7-8402-eb63473ab84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:27.152073 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447c275-f4a7-42e7-8402-eb63473ab84a admin admin] PATH_INFO: `/v3/projects/ffe8b4a82feb4956a1cef69c975abbba/users/3700ce2d3e84430d8b1bffce218959e4/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:27.166390 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447c275-f4a7-42e7-8402-eb63473ab84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe8b4a82feb4956a1cef69c975abbba, user_id=3700ce2d3e84430d8b1bffce218959e4, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:27.169083 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447c275-f4a7-42e7-8402-eb63473ab84a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:27.181447 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1455/2917] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:27 2022] PUT /identity/v3/projects/ffe8b4a82feb4956a1cef69c975abbba/users/3700ce2d3e84430d8b1bffce218959e4/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:27.193297 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b7f4c-c623-42de-993b-a047ca6f43ec None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:27.193787 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b7f4c-c623-42de-993b-a047ca6f43ec None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:27.193888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b7f4c-c623-42de-993b-a047ca6f43ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:27.221299 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-db2b7f4c-c623-42de-993b-a047ca6f43ec None None] MFA Rules not processed for user `3700ce2d3e84430d8b1bffce218959e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:27.222487 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-db2b7f4c-c623-42de-993b-a047ca6f43ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:27.231673 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:27.286937 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1463/2918] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:27.298962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447c275-f4a7-42e7-8402-eb63473ab84a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:27.300659 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a447c275-f4a7-42e7-8402-eb63473ab84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:27.355773 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447c275-f4a7-42e7-8402-eb63473ab84a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:27.359913 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfecebd-1442-41f3-8528-7765b64bc149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:27.360503 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfecebd-1442-41f3-8528-7765b64bc149 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:27.360797 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfecebd-1442-41f3-8528-7765b64bc149 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:27.361067 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfecebd-1442-41f3-8528-7765b64bc149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:27.369143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfecebd-1442-41f3-8528-7765b64bc149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:27.370551 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfecebd-1442-41f3-8528-7765b64bc149 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:27.380578 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1456/2919] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:29.918419 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b7f4c-c623-42de-993b-a047ca6f43ec None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:29.979847 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b7f4c-c623-42de-993b-a047ca6f43ec None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:29.984457 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:29.985078 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:29.985357 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:29.985630 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] PATH_INFO: `/v3/users/3700ce2d3e84430d8b1bffce218959e4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:29.986767 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3700ce2d3e84430d8b1bffce218959e4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:29.988695 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:30.034888 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3700ce2d3e84430d8b1bffce218959e4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.047859 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3700ce2d3e84430d8b1bffce218959e4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.054754 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3700ce2d3e84430d8b1bffce218959e4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.063064 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3700ce2d3e84430d8b1bffce218959e4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.063680 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3700ce2d3e84430d8b1bffce218959e4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.070063 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1464/2920] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:29 2022] DELETE /identity/v3/users/3700ce2d3e84430d8b1bffce218959e4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:30.074501 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ec8e3-2aa2-4932-bd0c-a9aa753f1bce None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.074997 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ec8e3-2aa2-4932-bd0c-a9aa753f1bce None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.075096 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ec8e3-2aa2-4932-bd0c-a9aa753f1bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.093993 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e69ec8e3-2aa2-4932-bd0c-a9aa753f1bce None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:30.095201 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e69ec8e3-2aa2-4932-bd0c-a9aa753f1bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:30.156504 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1457/2921] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:30.166112 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:30.167584 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:30.201609 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:30.227089 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902ef43-d804-43db-b2a4-c249b970fa03 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:30.230781 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ebe2c-ec49-4a9b-a3d3-3901457fdc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:30.231334 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ebe2c-ec49-4a9b-a3d3-3901457fdc10 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.231614 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ebe2c-ec49-4a9b-a3d3-3901457fdc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.231905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ebe2c-ec49-4a9b-a3d3-3901457fdc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.241302 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ebe2c-ec49-4a9b-a3d3-3901457fdc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:30.242773 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ebe2c-ec49-4a9b-a3d3-3901457fdc10 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:30.252908 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1465/2922] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:30.528832 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ec8e3-2aa2-4932-bd0c-a9aa753f1bce None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:30.530520 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e69ec8e3-2aa2-4932-bd0c-a9aa753f1bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:30.542696 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ec8e3-2aa2-4932-bd0c-a9aa753f1bce None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:30.548670 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:30.549302 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.549581 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.549852 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] PATH_INFO: `/v3/projects/ffe8b4a82feb4956a1cef69c975abbba` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.551062 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe8b4a82feb4956a1cef69c975abbba)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:30.552971 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:30.561854 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:30.603055 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe8b4a82feb4956a1cef69c975abbba', 'request_id': 'req-646cbc01-fe24-426c-8952-5c14a8e13f5d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.609790 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe8b4a82feb4956a1cef69c975abbba', 'request_id': 'req-646cbc01-fe24-426c-8952-5c14a8e13f5d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.615515 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe8b4a82feb4956a1cef69c975abbba', 'request_id': 'req-646cbc01-fe24-426c-8952-5c14a8e13f5d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.628276 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] The token cache is being invalidate because project ffe8b4a82feb4956a1cef69c975abbba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:30.628562 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.629192 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-646cbc01-fe24-426c-8952-5c14a8e13f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:30.630648 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1458/2923] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:30 2022] DELETE /identity/v3/projects/ffe8b4a82feb4956a1cef69c975abbba => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:30.635526 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e023b-fb1e-490b-9502-70a693a10a64 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.635805 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e023b-fb1e-490b-9502-70a693a10a64 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.636095 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e023b-fb1e-490b-9502-70a693a10a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.657005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-481e023b-fb1e-490b-9502-70a693a10a64 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:30.658185 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-481e023b-fb1e-490b-9502-70a693a10a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:30.717664 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1466/2924] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:44:30.725994 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90084c-7b0c-47eb-b2cf-b53ceb084fb0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.726301 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90084c-7b0c-47eb-b2cf-b53ceb084fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.726596 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90084c-7b0c-47eb-b2cf-b53ceb084fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.746536 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-bf90084c-7b0c-47eb-b2cf-b53ceb084fb0 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:30.748016 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bf90084c-7b0c-47eb-b2cf-b53ceb084fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:30.755870 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1459/2925] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:30.759977 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e023b-fb1e-490b-9502-70a693a10a64 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:30.769796 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e023b-fb1e-490b-9502-70a693a10a64 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:30.774426 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abfaaf-1283-447b-b779-937e7bc47126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:30.775005 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfaaf-1283-447b-b779-937e7bc47126 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.775289 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfaaf-1283-447b-b779-937e7bc47126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.775563 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfaaf-1283-447b-b779-937e7bc47126 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.776209 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abfaaf-1283-447b-b779-937e7bc47126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:44:30.776516 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abfaaf-1283-447b-b779-937e7bc47126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:30.778125 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abfaaf-1283-447b-b779-937e7bc47126 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:30.790152 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1467/2926] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 31 11:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:44:30.794460 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90084c-7b0c-47eb-b2cf-b53ceb084fb0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:30.804483 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90084c-7b0c-47eb-b2cf-b53ceb084fb0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:30.809157 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca32b0-dee0-4d7c-98ad-f29ae695a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:30.809749 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca32b0-dee0-4d7c-98ad-f29ae695a60a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.810028 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca32b0-dee0-4d7c-98ad-f29ae695a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.810298 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca32b0-dee0-4d7c-98ad-f29ae695a60a admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.810962 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca32b0-dee0-4d7c-98ad-f29ae695a60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:30.813002 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca32b0-dee0-4d7c-98ad-f29ae695a60a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:30.839589 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1460/2927] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 31 11:44:30 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:30.844182 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abfaaf-1283-447b-b779-937e7bc47126 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:30.853961 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abfaaf-1283-447b-b779-937e7bc47126 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:30.910198 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5478f-78ff-443a-a279-1904efb84dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:30.911070 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5478f-78ff-443a-a279-1904efb84dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.911469 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5478f-78ff-443a-a279-1904efb84dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.911640 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5478f-78ff-443a-a279-1904efb84dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.912405 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5478f-78ff-443a-a279-1904efb84dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:30.914391 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5478f-78ff-443a-a279-1904efb84dc8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:30.936188 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1468/2928] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 31 11:44:30 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:44:30.940316 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca32b0-dee0-4d7c-98ad-f29ae695a60a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:30.950464 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca32b0-dee0-4d7c-98ad-f29ae695a60a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:30.955907 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4105d-bf4e-4c1a-ad59-51eec8091b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:30.956510 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4105d-bf4e-4c1a-ad59-51eec8091b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.956798 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4105d-bf4e-4c1a-ad59-51eec8091b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.957070 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4105d-bf4e-4c1a-ad59-51eec8091b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.957716 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4105d-bf4e-4c1a-ad59-51eec8091b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:30.959356 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4105d-bf4e-4c1a-ad59-51eec8091b96 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:30.970786 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1461/2929] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:30.974746 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5478f-78ff-443a-a279-1904efb84dc8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:30.985307 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5478f-78ff-443a-a279-1904efb84dc8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:30.989852 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba934fc-f9d1-467d-ab4b-348e20509c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:30.990440 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba934fc-f9d1-467d-ab4b-348e20509c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:30.990905 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba934fc-f9d1-467d-ab4b-348e20509c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:30.991177 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba934fc-f9d1-467d-ab4b-348e20509c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:30.991809 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba934fc-f9d1-467d-ab4b-348e20509c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:30.993389 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba934fc-f9d1-467d-ab4b-348e20509c03 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:31.004477 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1469/2930] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 31 11:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:44:31.008407 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4105d-bf4e-4c1a-ad59-51eec8091b96 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:31.018885 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4105d-bf4e-4c1a-ad59-51eec8091b96 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:31.023554 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d278a7-bd10-4e89-baa5-f551fbb7f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:31.024193 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d278a7-bd10-4e89-baa5-f551fbb7f566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:31.024524 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d278a7-bd10-4e89-baa5-f551fbb7f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:31.024747 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d278a7-bd10-4e89-baa5-f551fbb7f566 admin admin] PATH_INFO: `/v3/projects/2af983bf9646460ba73471129bf20f1e/users/531dd6b7b7e346a88eea9075b5570ee8/roles/75f020c060fa465d828d5fcb8d48ad60` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:31.039780 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d278a7-bd10-4e89-baa5-f551fbb7f566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af983bf9646460ba73471129bf20f1e, user_id=531dd6b7b7e346a88eea9075b5570ee8, role_id=75f020c060fa465d828d5fcb8d48ad60)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:31.042429 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d278a7-bd10-4e89-baa5-f551fbb7f566 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:31.055742 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1462/2931] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 31 11:44:31 2022] PUT /identity/v3/projects/2af983bf9646460ba73471129bf20f1e/users/531dd6b7b7e346a88eea9075b5570ee8/roles/75f020c060fa465d828d5fcb8d48ad60 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:31.066391 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e242b-0920-479f-9336-705a3513e9fe None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:31.066676 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e242b-0920-479f-9336-705a3513e9fe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:31.066986 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e242b-0920-479f-9336-705a3513e9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:31.095492 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-058e242b-0920-479f-9336-705a3513e9fe None None] MFA Rules not processed for user `531dd6b7b7e346a88eea9075b5570ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:31.096707 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-058e242b-0920-479f-9336-705a3513e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:31.125572 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:31.162483 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1470/2932] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:44:31.174119 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d278a7-bd10-4e89-baa5-f551fbb7f566 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:31.175863 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e0d278a7-bd10-4e89-baa5-f551fbb7f566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:31.233342 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d278a7-bd10-4e89-baa5-f551fbb7f566 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:31.237107 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41a5d0-7f3b-4fed-b1a4-ba65eec685e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4db8824b7e4ae6880840e3c8680610', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:31.237703 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a5d0-7f3b-4fed-b1a4-ba65eec685e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:31.237982 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a5d0-7f3b-4fed-b1a4-ba65eec685e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:31.238254 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a5d0-7f3b-4fed-b1a4-ba65eec685e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:31.246425 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41a5d0-7f3b-4fed-b1a4-ba65eec685e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:31.248143 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41a5d0-7f3b-4fed-b1a4-ba65eec685e2 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:31.256961 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1463/2933] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:31.282760 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e242b-0920-479f-9336-705a3513e9fe None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:31.344281 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e242b-0920-479f-9336-705a3513e9fe None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:31.349140 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:31.349762 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:31.350040 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:31.350312 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] PATH_INFO: `/v3/users/531dd6b7b7e346a88eea9075b5570ee8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:31.351482 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=531dd6b7b7e346a88eea9075b5570ee8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:31.353406 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:31.399304 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531dd6b7b7e346a88eea9075b5570ee8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.411587 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531dd6b7b7e346a88eea9075b5570ee8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.418237 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531dd6b7b7e346a88eea9075b5570ee8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.425211 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531dd6b7b7e346a88eea9075b5570ee8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.426012 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531dd6b7b7e346a88eea9075b5570ee8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.431904 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1471/2934] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 31 11:44:31 2022] DELETE /identity/v3/users/531dd6b7b7e346a88eea9075b5570ee8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:31.436421 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a233721-521a-4880-a25d-c55e9a08fbd9 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:31.436705 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a233721-521a-4880-a25d-c55e9a08fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:31.437492 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a233721-521a-4880-a25d-c55e9a08fbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:31.457046 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2a233721-521a-4880-a25d-c55e9a08fbd9 None None] MFA Rules not processed for user `839a76c19ea54ec68f0ff11e282ae859`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:44:31.458233 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2a233721-521a-4880-a25d-c55e9a08fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:31.487207 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:31.519279 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1464/2935] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 31 11:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:44:31.529117 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:31.530521 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:31.583849 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:31.588050 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303edece-f03c-4b41-8250-039f39e85a8f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:31.592770 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17f3bb-a721-42b4-b155-81745b3818ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0f654bfe8364490a322b88433dd8fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:31.593886 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17f3bb-a721-42b4-b155-81745b3818ee service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:31.594226 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17f3bb-a721-42b4-b155-81745b3818ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:31.594560 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17f3bb-a721-42b4-b155-81745b3818ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:31.603899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17f3bb-a721-42b4-b155-81745b3818ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:31.605337 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17f3bb-a721-42b4-b155-81745b3818ee service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:31.614833 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1472/2936] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:44:31.880402 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a233721-521a-4880-a25d-c55e9a08fbd9 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:31.881824 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2a233721-521a-4880-a25d-c55e9a08fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:31.894333 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a233721-521a-4880-a25d-c55e9a08fbd9 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:31.898959 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839a76c19ea54ec68f0ff11e282ae859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677626bf39d04fc896037ceef125a07a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:31.899587 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:31.899862 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:31.900131 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] PATH_INFO: `/v3/projects/2af983bf9646460ba73471129bf20f1e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:31.901354 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af983bf9646460ba73471129bf20f1e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:31.903458 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:31.949724 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af983bf9646460ba73471129bf20f1e', 'request_id': 'req-bb299362-334b-4a7c-84bb-6851ba7f498c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.955748 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af983bf9646460ba73471129bf20f1e', 'request_id': 'req-bb299362-334b-4a7c-84bb-6851ba7f498c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.961173 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af983bf9646460ba73471129bf20f1e', 'request_id': 'req-bb299362-334b-4a7c-84bb-6851ba7f498c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.974120 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] The token cache is being invalidate because project 2af983bf9646460ba73471129bf20f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:44:31.974403 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.975052 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb299362-334b-4a7c-84bb-6851ba7f498c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:44:31.976544 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1465/2937] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 31 11:44:31 2022] DELETE /identity/v3/projects/2af983bf9646460ba73471129bf20f1e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:44:41.610738 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:41.970966 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:37.300192 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb2a4-7986-43f4-b22d-99b6f5eb5a33 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:48:37.300786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb2a4-7986-43f4-b22d-99b6f5eb5a33 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:48:37.300786 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb2a4-7986-43f4-b22d-99b6f5eb5a33 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:48:37.302076 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1473/2938] 10.222.0.64 () {54 vars in 961 bytes} [Wed Aug 31 11:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:48:37.306988 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2f8f6-efd7-4e81-980c-541449dce02d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:48:37.307468 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2f8f6-efd7-4e81-980c-541449dce02d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:48:37.307636 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2f8f6-efd7-4e81-980c-541449dce02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:48:37.357866 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-84e2f8f6-efd7-4e81-980c-541449dce02d None None] MFA Rules not processed for user `cc99489aa0e14928871b6f7b2c955068`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:48:37.359361 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-84e2f8f6-efd7-4e81-980c-541449dce02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:48:37.432397 dv-cinder-839768-3-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1466/2939] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Aug 31 11:48:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:48:37.440650 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb2a4-7986-43f4-b22d-99b6f5eb5a33 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:48:37.455973 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb2a4-7986-43f4-b22d-99b6f5eb5a33 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:48:37.461899 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e3a8-1de5-46ce-b8c1-c42d20437866 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc99489aa0e14928871b6f7b2c955068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e34048dd48a040f6a440874e3945569f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:48:37.462510 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e3a8-1de5-46ce-b8c1-c42d20437866 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:48:37.462826 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e3a8-1de5-46ce-b8c1-c42d20437866 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:48:37.463102 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e3a8-1de5-46ce-b8c1-c42d20437866 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:48:37.464974 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7ba0e3a8-1de5-46ce-b8c1-c42d20437866 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:48:37.480475 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0e3a8-1de5-46ce-b8c1-c42d20437866 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:48:37.482230 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0e3a8-1de5-46ce-b8c1-c42d20437866 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:48:37.493941 dv-cinder-839768-3-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1474/2940] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 31 11:48:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:48:47.422920 dv-cinder-839768-3-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=39 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:47.488988 dv-cinder-839768-3-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}